Add Contributor Conversion & Drop-off Funnel Visualizations #914

Akshatb2006 · 2025-08-25T09:48:15Z

1. Funnel Chart: Contributor Levels & Drop-offs

This funnel visualization displays contributors at different engagement levels within the project and tracks their drop-offs between stages.

Purpose

Helps identify bottlenecks in contributor progression and understand where contributors disengage.

Structure

The funnel is divided into two parallel views:

Contributors Funnel – Shows how many contributors exist at each level.
Drop-offs Funnel – Displays the number of contributors lost at each level transition.

Levels

New Contributors – First-time contributors who have just joined or made their initial interaction.
Active Contributors – Contributors actively engaging in discussions, issues, or code reviews.
Core Contributors – Key members consistently contributing and leading initiatives.

This visualization makes it easy to spot where retention can be improved.

2. Radar Chart: Contributor Activities Distribution

This radar chart visualizes the distribution of contributors across various activity dimensions.

Purpose

Provides a quick snapshot of where contributors are spending their efforts in the project.

Dimensions include (example categories)

Issue Reporting
Pr merging
Pr opening
Pr commentors

By analyzing this chart, project maintainers can understand contributor focus areas and where more engagement is needed.

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

…06/8Knot into contributor_engagement

…kshatb2006/8Knot into contributor_engagement" This reverts commit c2a4776, reversing changes made to 4b4f0a7.

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

- Updated query to use augur_data.contributor_engagement table instead of non-existent tables - Fixed schema references (tables were in public schema, not augur_data) - Improved funnel logic to show proper progression: All Contributors -> Basic Engagement -> Deep Engagement - Query now returns meaningful data instead of empty results

- Added n_repolist_uses=3 to caching_wrapper call to properly handle multiple %s placeholders - This should resolve the 'tuple index out of range' error in worker execution

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

…06/8Knot into contributor_engagement

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

cdolfi

will do a full review later, a few comments

8Knot/pages/contributors/cntrb_behavior.py

cdolfi · 2025-08-25T10:25:08Z

8Knot/pages/contributors/visualizations/contributor_funnel.py

+            style={"padding": "1.5rem"},
+        ),
+    ],
+    className="dark-card",


each card should be its own file

Both the cards are connected, so we put this in the same file. Do you want us to create seperate file for putting gc_contributor_dropoff?

8Knot/pages/contributors/visualizations/contributor_radar.py

cdolfi · 2025-08-25T10:26:15Z

8Knot/pages/contributors/visualizations/contributor_radar.py

+
+def create_figure(df: pd.DataFrame):
+    """Create the radar chart figure."""
+    activity_metrics = {


this should be in process data

done with commit cf5933a

cdolfi · 2025-08-25T10:33:15Z

8Knot/queries/contributors_query.py

-@celery_app.task(
-    bind=True,
-    autoretry_for=(Exception,),
-    exponential_backoff=2,


This query should not be edited

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

cdolfi

Each of the graph info descriptions should be a lot more detailed, especially with how complicated each of the graphs are. It should go into what data goes into the graph and how it is being displayed or. The lottery factor graphs would be a good example to look into or see how project velocity links to a much more thorough description of the graph. I will be able to give a better review once the query is able to populate the graphs. Please add more comments to your code as well so a reviewer can understand your preprocessing steps.

cdolfi · 2025-09-10T20:52:28Z

8Knot/queries/issue_assignee_query.py

    df = df[df.created < dt.date.today()]
    """

    logging.warning(f"{issue_assignee_query.__name__} COLLECTION - END")


no change, remove line change

cdolfi · 2025-09-10T20:52:39Z

8Knot/queries/contributors_query.py

    df["created_at"] = pd.to_datetime(df["created_at"], utc=True).dt.date
    df = df[df.created_at < dt.date.today()]

    Additional post-processing done on-the-fly in 8knot/pages/utils/preprocessing_utils.py


no change remove line change

cdolfi · 2025-09-10T20:54:44Z

8Knot/queries/contributor_funnel_query.py

+            d2_total_comments,
+            d2_has_pr_with_many_commits,
+            d2_commented_on_multiple_prs
+        FROM augur_data.contributor_engagement


What table is this? We do not have it in our augur instance

if it is a materialized view on your own instance you will need to use the query that generates that materialized view here

cdolfi · 2025-09-10T20:55:54Z

8Knot/pages/contributors/visualizations/contributor_funnel.py

@@ -0,0 +1,333 @@
+from dash import html, dcc, callback


this should be on the chaoss page

cdolfi · 2025-09-10T20:56:25Z

8Knot/pages/contributors/visualizations/contributor_funnel.py

+            style={"padding": "1.5rem"},
+        ),
+    ],
+    className="dark-card",


cdolfi · 2025-09-10T21:02:13Z

8Knot/pages/chaoss/visualizations/contributor_radar.py

+    logging.warning(f"{VIZ_ID} - START")
+    start = time.perf_counter()
+
+    # GET ALL DATA FROM POSTGRES CACHE


why are bots not filtered out?

cdolfi · 2025-09-10T21:03:29Z

8Knot/pages/chaoss/visualizations/contributor_radar.py

+    ).reset_index()
+
+    # remove bot data if switch is on
+    if bot_switch and "cntrb_id" in df_agg.columns:


move into prior function, this applies through line 194

cdolfi · 2025-09-10T21:04:06Z

8Knot/pages/chaoss/visualizations/contributor_radar.py

+        return nodata_graph()
+
+    # Create the radar chart figure
+    activity_metrics = {


this should be in a create_figure function. See other visualizations or the template

cdolfi · 2025-09-10T21:04:23Z

8Knot/pages/contributors/cntrb_behavior.py

        ),
+        dbc.Row(
+            [
+                dbc.Col(gc_contributor_funnel, width=6),


move to chaoss page

cdolfi · 2025-09-10T21:09:04Z

8Knot/pages/contributors/visualizations/contributor_funnel.py

+
+    func_name = ceq.__name__
+    not_cached = cf.get_uncached(func_name=func_name, repolist=repolist)
+    if not_cached:


same comments as the other visualization

officialasishkumar · 2025-09-11T10:02:06Z

Thanks for the review comments! Will update the PR accordingly

Akshatb2006 and others added 25 commits August 8, 2025 23:37

funnel chart

5fe5396

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

fix: import issue

09a189c

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

feat: contributors funnel chart

dc9ceba

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

funnel chart: solved bug for callback and data population

4b4f0a7

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

Merge branch 'contributor_engagement' of https://github.com/Akshatb20…

c2a4776

…06/8Knot into contributor_engagement

Revert "Merge branch 'contributor_engagement' of https://github.com/A…

d439507

…kshatb2006/8Knot into contributor_engagement" This reverts commit c2a4776, reversing changes made to 4b4f0a7.

query for funnel chart

03ebbda

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

funnel query revised

e7fb9a7

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

new funnel chart

53850f7

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

radar chart

90748f1

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

funnel chart with drop-off

799498b

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

feat: divide charts

277abb2

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

feat: viz template in new charts

f49d15e

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

Fix contributor funnel query parameter usage

cd43be5

- Added n_repolist_uses=3 to caching_wrapper call to properly handle multiple %s placeholders - This should resolve the 'tuple index out of range' error in worker execution

funnel chart final

089000f

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

Merge branch 'oss-aspen:dev' into contributor_engagement

c753ca9

funnel

5e337e4

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

Merge branch 'contributor_engagement' of https://github.com/Akshatb20…

7245719

…06/8Knot into contributor_engagement

imports

417d063

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

imports fixed

55ef5d3

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

feat: improve the ui

2a3470e

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

Merge branch 'oss-aspen:dev' into contributor_engagement

52a1381

fix: time filter

561dd6f

fix: revert 2 levels of drop off

8bbed1a

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

cdolfi requested changes Aug 25, 2025

View reviewed changes

shifting radar to chaoss page

c07a223

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

Akshatb2006 force-pushed the contributor_engagement branch from f11ee1a to c07a223 Compare August 25, 2025 12:16

officialasishkumar and others added 2 commits August 25, 2025 23:20

fix: restore contributor query

0a7ff1c

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

radar queries

625eed6

Signed-off-by: Akshat Baranwal <kysuakshat23@gmail.com>

officialasishkumar added 2 commits August 25, 2025 23:43

fix: use contributor_query for radar

85df2a0

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

fix: merge process data and create figure

27b338b

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

officialasishkumar force-pushed the contributor_engagement branch from cf5933a to 27b338b Compare August 25, 2025 18:39

cdolfi requested changes Sep 10, 2025

View reviewed changes

Add Contributor Conversion & Drop-off Funnel Visualizations #914

Are you sure you want to change the base?

Add Contributor Conversion & Drop-off Funnel Visualizations #914

Uh oh!

Conversation

Akshatb2006 commented Aug 25, 2025

1. Funnel Chart: Contributor Levels & Drop-offs

Purpose

Structure

Levels

2. Radar Chart: Contributor Activities Distribution

Purpose

Dimensions include (example categories)

Uh oh!

cdolfi left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

cdolfi left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

officialasishkumar commented Sep 11, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants