Skip to content

Commit 006a499

Browse files
Ground more wiki pages in podcast evidence
1 parent ffe604c commit 006a499

26 files changed

Lines changed: 8908 additions & 4258 deletions

CONTENT_TODO.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -14,10 +14,10 @@ Follow these rules when adding any page from this backlog.
1414
selected.
1515
- Keep `_podcast_summaries/` compact enough for agents to decide whether they
1616
need the source episode.
17-
- Link podcast evidence to specific episode URLs such as
18-
`https://datatalks.club/podcast/<source-file-slug>.html` when the source
19-
episode is known. Use `https://datatalks.club/podcast.html` only as a
20-
temporary fallback.
17+
- Link podcast evidence to local podcast summary pages such as
18+
`{{ '/podcasts/<source-file-slug>/' | relative_url }}`. Those local pages
19+
link to the canonical DataTalks.Club episode. Do not link article or wiki
20+
evidence to the generic podcast archive page.
2121
- Run `make check` after adding pages so graph and search stay current.
2222

2323
## Current Rewrite Requirements

_articles/apache-airflow.md

Lines changed: 222 additions & 259 deletions
Large diffs are not rendered by default.

_articles/data-engineer-bootcamp.md

Lines changed: 189 additions & 203 deletions
Large diffs are not rendered by default.

_articles/data-engineering-course.md

Lines changed: 309 additions & 271 deletions
Large diffs are not rendered by default.

_articles/data-engineering-training.md

Lines changed: 189 additions & 261 deletions
Large diffs are not rendered by default.

_articles/dataops-tools.md

Lines changed: 271 additions & 269 deletions
Large diffs are not rendered by default.

_articles/designing-machine-learning-systems.md

Lines changed: 290 additions & 343 deletions
Large diffs are not rendered by default.

_articles/machine-learning-for-software-engineers.md

Lines changed: 241 additions & 286 deletions
Large diffs are not rendered by default.

_articles/mlops-frameworks.md

Lines changed: 268 additions & 270 deletions
Large diffs are not rendered by default.

_wiki/applied-research.md

Lines changed: 153 additions & 66 deletions
Original file line numberDiff line numberDiff line change
@@ -1,84 +1,171 @@
11
---
22
layout: wiki
33
title: "Applied Research"
4-
summary: "How the archive describes applied research as hypothesis-driven ML work that turns uncertain ideas into reusable artifacts, products, and production systems."
4+
summary: "How DataTalks.Club guests describe applied research as hypothesis-driven work that turns uncertain ML ideas into products, reusable systems, and production-ready evidence."
55
related:
66
- Machine Learning
77
- Production
88
- Machine Learning System Design
99
- Academic Researcher to Data Science
10-
- AI
10+
- Experimentation
11+
- MLOps
1112
---
1213

13-
## Definition and Scope
14-
15-
Teams do applied research when they aim research at a practical product,
16-
workflow, or business decision. In the podcast archive, applied researchers
17-
produce datasets and models. They also produce benchmarks, experiments,
18-
prototypes, and product insights. The work is still scientific, but it's
19-
anchored to a use case and domain. Production constraints guide it too.
20-
21-
Use this page when evidence connects research to practical ML systems. Use
22-
[Academic Researcher to Data Science]({{ '/wiki/academic-researcher-to-data-science/' | relative_url }})
23-
for career-transition material.
24-
25-
26-
## Recurring Archive Themes
27-
28-
Teams start applied research with hypotheses, not only models. Vin Vashishta
29-
describes the first model as a hypothesis about how a system works. The
30-
researcher then uses data, experiments, model behavior, and explainability to
31-
refine that hypothesis. Production feedback can confirm or reject it.
32-
33-
Research teams should make artifacts reusable. Guests treat novel datasets,
34-
benchmarks, model prototypes, and experimental results as intellectual property
35-
that downstream data scientists and ML engineers can reuse. Reusable research is
36-
valuable when it improves the next product decision or production build.
37-
38-
The research-to-production gap is organizational as much as technical. Mihail
39-
Eric argues for embedded teams, role fluidity, researcher code reviews, and
40-
engineers who read papers or reproduce models. Researchers and engineers
41-
struggle when a team throws notebooks over the wall with unclear assumptions.
42-
43-
When teams deploy research in the real world, the research question changes.
44-
Computer-vision and autonomous-driving episodes move from model quality to
45-
latency and sensor cost. They also bring in labeling, simulation, staged
46-
rollouts, and privacy. Safety checks, edge cases, and system coordination
47-
become part of the work too.
48-
49-
## Episode Evidence
50-
51-
These episodes give the strongest applied-research evidence.
52-
53-
- [Monetize Machine Learning](https://datatalks.club/podcast.html)
54-
(20:15-29:18) separates applied researchers from science
55-
researchers and frames applied research as business-aligned artifact creation.
56-
- [Monetize Machine Learning](https://datatalks.club/podcast.html)
57-
(36:10-43:28) defines research as hypothesis design,
58-
experimentation, and explainability while also covering model deconstruction
59-
and iterative evidence gathering.
60-
- [From Research to Production](https://datatalks.club/podcast.html)
61-
(8:34-20:25) covers research infrastructure, prototyping, and benchmarks while
62-
Mihail also discusses experimental tooling and deployment stacks.
63-
- [From Research to Production](https://datatalks.club/podcast.html)
64-
(23:32-51:28) covers reproducibility, engineering rigor,
65-
embedded teams, and code reviews. Later sections cover end-to-end systems,
66-
paper reading, and model reproduction.
67-
- [Applying Computer Vision Research to Production AI](https://datatalks.club/podcast.html)
68-
(29:45-36:12) describes simulation, closed-track testing, and
69-
on-road testing. Aishwarya also covers anonymized sensor data, labeling
70-
strategy, safety checks, and staged deployments.
71-
- [Applying Computer Vision Research to Production AI](https://datatalks.club/podcast.html)
72-
(51:28-55:25) discusses sensitive-case evaluation, broader scenario
73-
tests, gradual rollout, and multimodal LLM constraints.
14+
## Definition
15+
16+
Teams do applied research when they aim research at a practical decision,
17+
product, or system. In the DataTalks.Club archive, guests use the term for work
18+
that still has scientific uncertainty but must produce something a team can use.
19+
That output may be a dataset, benchmark, or prototype. It may also be a
20+
modeling approach, validation method, or production design.
21+
22+
That puts applied research between [machine learning]({{ '/wiki/machine-learning/' | relative_url }}),
23+
[experimentation]({{ '/wiki/experimentation/' | relative_url }}), and
24+
[production]({{ '/wiki/production/' | relative_url }}). It isn't only paper
25+
reading or model training. It also includes the work needed to decide whether an
26+
idea can survive product constraints, engineering constraints, and real users.
27+
28+
## Common Definition
29+
30+
Across the interviews applied research means hypothesis-driven technical work
31+
with a use case attached. In
32+
[Monetize Machine Learning]({{ '/podcasts/make-money-with-machine-learning-roles-skills/' | relative_url }}),
33+
[Vin Vashishta]({{ '/people/vinvashishta/' | relative_url }}) describes machine
34+
learning research as artifact creation. Teams create datasets, run experiments,
35+
study model behavior, and build knowledge that can support ML products. Around
36+
the 36:10 chapter, he frames the research skill set around hypothesis design and
37+
experimentation. He also includes explainability and iterative evidence
38+
gathering.
39+
40+
[Mihail Eric]({{ '/people/mihaileric/' | relative_url }}) gives the matching
41+
engineering version in
42+
[From Research to Production]({{ '/podcasts/research-to-production-ml-systems-roadmap/' | relative_url }}).
43+
At 8:34 and 10:52, he connects research infrastructure with data collection and
44+
prototyping. He also connects it with hypotheses and benchmarks. His version of
45+
applied research doesn't stop when a notebook works. Researchers continue until
46+
the idea can move
47+
toward a reproducible [ML system design]({{ '/wiki/machine-learning-system-design/' | relative_url }}).
48+
49+
The common definition is practical. A team tests an uncertain technical idea and
50+
turns what it learns into reusable evidence for product, engineering, or
51+
business decisions.
52+
53+
## Guest Differences
54+
55+
Guests agree on the hypothesis-driven part, but they focus on different outputs.
56+
57+
[Vin Vashishta]({{ '/people/vinvashishta/' | relative_url }}) puts applied
58+
research close to [data products]({{ '/wiki/data-products/' | relative_url }})
59+
and ML monetization. In
60+
[Monetize Machine Learning]({{ '/podcasts/make-money-with-machine-learning-roles-skills/' | relative_url }}),
61+
the 20:15 and 26:58 chapters separate research work from pure product
62+
management and pure architecture. Researchers create the technical evidence
63+
that lets a team decide whether a model can become a revenue-generating product.
64+
65+
[Mihail Eric]({{ '/people/mihaileric/' | relative_url }}) puts the boundary
66+
between research and [MLOps]({{ '/wiki/mlops/' | relative_url }}) under
67+
pressure. In
68+
[From Research to Production]({{ '/podcasts/research-to-production-ml-systems-roadmap/' | relative_url }}),
69+
the 23:32, 30:16, and 34:20 chapters argue that researchers need engineering
70+
rigor and engineers need experimental rigor. He describes embedded teams and
71+
code reviews for researchers. He also describes engineers who read papers or
72+
reproduce models.
73+
74+
[Aishwarya Jadhav]({{ '/people/aishwaryajadhav/' | relative_url }}) makes the
75+
definition domain-specific. In
76+
[Applying Computer Vision Research to Building Production-Ready AI Systems]({{ '/podcasts/from-computer-vision-research-to-autonomous-driving-ai/' | relative_url }}),
77+
she ties applied research to sensors, latency, and labeling strategy. She also
78+
ties it to safety checks and staged deployment. The 29:45 and 32:43 chapters
79+
connect [computer vision]({{ '/wiki/computer-vision/' | relative_url }})
80+
research in autonomous driving with simulation and closed-track tests. They also
81+
cover on-road tests and release controls before the system becomes usable.
82+
83+
## Turning Research Into Product Decisions
84+
85+
Teams benefit from applied research when it changes a decision. In Vin
86+
Vashishta's
87+
[Monetize Machine Learning]({{ '/podcasts/make-money-with-machine-learning-roles-skills/' | relative_url }}),
88+
the 43:28 chapter connects product management with researchable use cases. A
89+
business question has to become a technical hypothesis before researchers can
90+
test it. The 48:54 chapter adds feasibility studies and gated decisions, which
91+
keeps research connected to product risk instead of open-ended exploration.
92+
93+
[Loris Marini]({{ '/people/lorismarini/' | relative_url }}) describes a similar
94+
SaaS case. In
95+
[Data Professionals Need Business Skills in SaaS]({{ '/podcasts/data-professionals-business-skills-in-saas/' | relative_url }}),
96+
the 2:45 chapter describes research skills applied in a startup. The 8:30
97+
chapter discusses reinforcement learning applied to practical problems. That
98+
episode ties applied research to stakeholder language and business metrics. It
99+
also ties the work to model deployment rather than treating research as a
100+
separate track.
101+
102+
For a data team, applied research should produce a decision-ready answer. The
103+
team should know whether to continue, stop, or simplify. It should also know
104+
whether to collect different data, change the metric, or move toward production.
105+
That connects the topic to
106+
[experimentation and causal inference]({{ '/wiki/experimentation-and-causal-inference/' | relative_url }})
107+
when the main question is evidence quality. It connects to
108+
[machine learning system design]({{ '/wiki/machine-learning-system-design/' | relative_url }})
109+
when the main question is whether the approach can be served reliably.
110+
111+
## Engineering And Reproducibility
112+
113+
The archive repeatedly treats reproducibility as part of applied research, not
114+
as cleanup after the fact. In
115+
[From Research to Production]({{ '/podcasts/research-to-production-ml-systems-roadmap/' | relative_url }}),
116+
[Mihail Eric]({{ '/people/mihaileric/' | relative_url }}) says researchers need
117+
engineering rigor at the 23:32 chapter. In the 44:36 and 46:57 chapters, he
118+
recommends end-to-end systems, deployment practice, and code reviews. If no one
119+
can reproduce the result or run the system, the research can't guide production
120+
work.
121+
122+
[Johanna Bayer]({{ '/people/johannabayer/' | relative_url }}) makes the same
123+
argument from academia in
124+
[Teaching Open Science and Reproducible Research]({{ '/podcasts/teaching-reproducible-research-and-open-science-coding-practices-for-academia/' | relative_url }}).
125+
At 8:30, she discusses reproducible manuscripts with embedded code. At 12:10
126+
and 16:36, she frames research software engineering around software-focused
127+
research outputs and reusable toolboxes. Her
128+
discussion connects applied research with [open source]({{ '/wiki/open-source/' | relative_url }})
129+
and [software engineering]({{ '/wiki/software-engineering/' | relative_url }}).
130+
131+
[Eleni Tzirita Zacharatou]({{ '/people/elenitziritazacharatou/' | relative_url }})
132+
adds a systems-research version in
133+
[Big Data Analytics and Postdoc Research]({{ '/podcasts/big-data-analytics-and-postdoc-research/' | relative_url }}).
134+
The 23:08 and 24:15 chapters discuss Nebula Stream and Agora infrastructure.
135+
They also discuss system-driven research that grows from earlier
136+
stream-processing systems such as Apache Flink. In that setting, researchers do
137+
not only produce an insight. They also produce an infrastructure idea that other
138+
researchers or industry teams can
139+
evaluate.
140+
141+
## Domain Constraints
142+
143+
The work changes when the deployment domain changes. In
144+
[Applying Computer Vision Research to Building Production-Ready AI Systems]({{ '/podcasts/from-computer-vision-research-to-autonomous-driving-ai/' | relative_url }}),
145+
[Aishwarya Jadhav]({{ '/people/aishwaryajadhav/' | relative_url }}) discusses
146+
sensor tradeoffs at 11:22 and on-vehicle inference at 22:17. She covers model
147+
compression at 23:28 and staged validation from 29:45 onward. Those constraints
148+
make the research question more specific than "which model is best?" The team
149+
has to ask which model works under the product's cost, latency, privacy, and
150+
safety requirements.
151+
152+
In the same episode, the 51:28 chapter discusses sensitive-case testing and the
153+
52:53 chapter discusses multimodal LLMs in autonomous-driving contexts. This is
154+
why applied research often links to [LLM production patterns]({{ '/wiki/llm-production-patterns/' | relative_url }})
155+
and [notebook-to-production AI systems]({{ '/wiki/notebook-to-production-ai-systems/' | relative_url }}).
156+
The research idea has to meet evaluation, rollout, monitoring, and system
157+
coordination constraints before a team can operate it.
74158

75159
## Related Pages
76160

77-
Use these pages for adjacent ML, production, and career material.
161+
These pages cover the adjacent roles, systems, and practices that appear in the
162+
same podcast discussions.
78163

79164
- [Machine Learning]({{ '/wiki/machine-learning/' | relative_url }})
165+
- [Experimentation]({{ '/wiki/experimentation/' | relative_url }})
166+
- [MLOps]({{ '/wiki/mlops/' | relative_url }})
80167
- [Production]({{ '/wiki/production/' | relative_url }})
81168
- [Machine Learning System Design]({{ '/wiki/machine-learning-system-design/' | relative_url }})
82169
- [Academic Researcher to Data Science]({{ '/wiki/academic-researcher-to-data-science/' | relative_url }})
83-
- [AI]({{ '/wiki/ai/' | relative_url }})
84-
- [MLOps]({{ '/wiki/mlops/' | relative_url }})
170+
- [Computer Vision]({{ '/wiki/computer-vision/' | relative_url }})
171+
- [Open Source]({{ '/wiki/open-source/' | relative_url }})

0 commit comments

Comments
 (0)