|
1 | 1 | --- |
2 | 2 | layout: wiki |
3 | 3 | title: "Applied Research" |
4 | | -summary: "How the archive describes applied research as hypothesis-driven ML work that turns uncertain ideas into reusable artifacts, products, and production systems." |
| 4 | +summary: "How DataTalks.Club guests describe applied research as hypothesis-driven work that turns uncertain ML ideas into products, reusable systems, and production-ready evidence." |
5 | 5 | related: |
6 | 6 | - Machine Learning |
7 | 7 | - Production |
8 | 8 | - Machine Learning System Design |
9 | 9 | - Academic Researcher to Data Science |
10 | | - - AI |
| 10 | + - Experimentation |
| 11 | + - MLOps |
11 | 12 | --- |
12 | 13 |
|
13 | | -## Definition and Scope |
14 | | - |
15 | | -Teams do applied research when they aim research at a practical product, |
16 | | -workflow, or business decision. In the podcast archive, applied researchers |
17 | | -produce datasets and models. They also produce benchmarks, experiments, |
18 | | -prototypes, and product insights. The work is still scientific, but it's |
19 | | -anchored to a use case and domain. Production constraints guide it too. |
20 | | - |
21 | | -Use this page when evidence connects research to practical ML systems. Use |
22 | | -[Academic Researcher to Data Science]({{ '/wiki/academic-researcher-to-data-science/' | relative_url }}) |
23 | | -for career-transition material. |
24 | | - |
25 | | - |
26 | | -## Recurring Archive Themes |
27 | | - |
28 | | -Teams start applied research with hypotheses, not only models. Vin Vashishta |
29 | | -describes the first model as a hypothesis about how a system works. The |
30 | | -researcher then uses data, experiments, model behavior, and explainability to |
31 | | -refine that hypothesis. Production feedback can confirm or reject it. |
32 | | - |
33 | | -Research teams should make artifacts reusable. Guests treat novel datasets, |
34 | | -benchmarks, model prototypes, and experimental results as intellectual property |
35 | | -that downstream data scientists and ML engineers can reuse. Reusable research is |
36 | | -valuable when it improves the next product decision or production build. |
37 | | - |
38 | | -The research-to-production gap is organizational as much as technical. Mihail |
39 | | -Eric argues for embedded teams, role fluidity, researcher code reviews, and |
40 | | -engineers who read papers or reproduce models. Researchers and engineers |
41 | | -struggle when a team throws notebooks over the wall with unclear assumptions. |
42 | | - |
43 | | -When teams deploy research in the real world, the research question changes. |
44 | | -Computer-vision and autonomous-driving episodes move from model quality to |
45 | | -latency and sensor cost. They also bring in labeling, simulation, staged |
46 | | -rollouts, and privacy. Safety checks, edge cases, and system coordination |
47 | | -become part of the work too. |
48 | | - |
49 | | -## Episode Evidence |
50 | | - |
51 | | -These episodes give the strongest applied-research evidence. |
52 | | - |
53 | | -- [Monetize Machine Learning](https://datatalks.club/podcast.html) |
54 | | - (20:15-29:18) separates applied researchers from science |
55 | | - researchers and frames applied research as business-aligned artifact creation. |
56 | | -- [Monetize Machine Learning](https://datatalks.club/podcast.html) |
57 | | - (36:10-43:28) defines research as hypothesis design, |
58 | | - experimentation, and explainability while also covering model deconstruction |
59 | | - and iterative evidence gathering. |
60 | | -- [From Research to Production](https://datatalks.club/podcast.html) |
61 | | - (8:34-20:25) covers research infrastructure, prototyping, and benchmarks while |
62 | | - Mihail also discusses experimental tooling and deployment stacks. |
63 | | -- [From Research to Production](https://datatalks.club/podcast.html) |
64 | | - (23:32-51:28) covers reproducibility, engineering rigor, |
65 | | - embedded teams, and code reviews. Later sections cover end-to-end systems, |
66 | | - paper reading, and model reproduction. |
67 | | -- [Applying Computer Vision Research to Production AI](https://datatalks.club/podcast.html) |
68 | | - (29:45-36:12) describes simulation, closed-track testing, and |
69 | | - on-road testing. Aishwarya also covers anonymized sensor data, labeling |
70 | | - strategy, safety checks, and staged deployments. |
71 | | -- [Applying Computer Vision Research to Production AI](https://datatalks.club/podcast.html) |
72 | | - (51:28-55:25) discusses sensitive-case evaluation, broader scenario |
73 | | - tests, gradual rollout, and multimodal LLM constraints. |
| 14 | +## Definition |
| 15 | + |
| 16 | +Teams do applied research when they aim research at a practical decision, |
| 17 | +product, or system. In the DataTalks.Club archive, guests use the term for work |
| 18 | +that still has scientific uncertainty but must produce something a team can use. |
| 19 | +That output may be a dataset, benchmark, or prototype. It may also be a |
| 20 | +modeling approach, validation method, or production design. |
| 21 | + |
| 22 | +That puts applied research between [machine learning]({{ '/wiki/machine-learning/' | relative_url }}), |
| 23 | +[experimentation]({{ '/wiki/experimentation/' | relative_url }}), and |
| 24 | +[production]({{ '/wiki/production/' | relative_url }}). It isn't only paper |
| 25 | +reading or model training. It also includes the work needed to decide whether an |
| 26 | +idea can survive product constraints, engineering constraints, and real users. |
| 27 | + |
| 28 | +## Common Definition |
| 29 | + |
| 30 | +Across the interviews applied research means hypothesis-driven technical work |
| 31 | +with a use case attached. In |
| 32 | +[Monetize Machine Learning]({{ '/podcasts/make-money-with-machine-learning-roles-skills/' | relative_url }}), |
| 33 | +[Vin Vashishta]({{ '/people/vinvashishta/' | relative_url }}) describes machine |
| 34 | +learning research as artifact creation. Teams create datasets, run experiments, |
| 35 | +study model behavior, and build knowledge that can support ML products. Around |
| 36 | +the 36:10 chapter, he frames the research skill set around hypothesis design and |
| 37 | +experimentation. He also includes explainability and iterative evidence |
| 38 | +gathering. |
| 39 | + |
| 40 | +[Mihail Eric]({{ '/people/mihaileric/' | relative_url }}) gives the matching |
| 41 | +engineering version in |
| 42 | +[From Research to Production]({{ '/podcasts/research-to-production-ml-systems-roadmap/' | relative_url }}). |
| 43 | +At 8:34 and 10:52, he connects research infrastructure with data collection and |
| 44 | +prototyping. He also connects it with hypotheses and benchmarks. His version of |
| 45 | +applied research doesn't stop when a notebook works. Researchers continue until |
| 46 | +the idea can move |
| 47 | +toward a reproducible [ML system design]({{ '/wiki/machine-learning-system-design/' | relative_url }}). |
| 48 | + |
| 49 | +The common definition is practical. A team tests an uncertain technical idea and |
| 50 | +turns what it learns into reusable evidence for product, engineering, or |
| 51 | +business decisions. |
| 52 | + |
| 53 | +## Guest Differences |
| 54 | + |
| 55 | +Guests agree on the hypothesis-driven part, but they focus on different outputs. |
| 56 | + |
| 57 | +[Vin Vashishta]({{ '/people/vinvashishta/' | relative_url }}) puts applied |
| 58 | +research close to [data products]({{ '/wiki/data-products/' | relative_url }}) |
| 59 | +and ML monetization. In |
| 60 | +[Monetize Machine Learning]({{ '/podcasts/make-money-with-machine-learning-roles-skills/' | relative_url }}), |
| 61 | +the 20:15 and 26:58 chapters separate research work from pure product |
| 62 | +management and pure architecture. Researchers create the technical evidence |
| 63 | +that lets a team decide whether a model can become a revenue-generating product. |
| 64 | + |
| 65 | +[Mihail Eric]({{ '/people/mihaileric/' | relative_url }}) puts the boundary |
| 66 | +between research and [MLOps]({{ '/wiki/mlops/' | relative_url }}) under |
| 67 | +pressure. In |
| 68 | +[From Research to Production]({{ '/podcasts/research-to-production-ml-systems-roadmap/' | relative_url }}), |
| 69 | +the 23:32, 30:16, and 34:20 chapters argue that researchers need engineering |
| 70 | +rigor and engineers need experimental rigor. He describes embedded teams and |
| 71 | +code reviews for researchers. He also describes engineers who read papers or |
| 72 | +reproduce models. |
| 73 | + |
| 74 | +[Aishwarya Jadhav]({{ '/people/aishwaryajadhav/' | relative_url }}) makes the |
| 75 | +definition domain-specific. In |
| 76 | +[Applying Computer Vision Research to Building Production-Ready AI Systems]({{ '/podcasts/from-computer-vision-research-to-autonomous-driving-ai/' | relative_url }}), |
| 77 | +she ties applied research to sensors, latency, and labeling strategy. She also |
| 78 | +ties it to safety checks and staged deployment. The 29:45 and 32:43 chapters |
| 79 | +connect [computer vision]({{ '/wiki/computer-vision/' | relative_url }}) |
| 80 | +research in autonomous driving with simulation and closed-track tests. They also |
| 81 | +cover on-road tests and release controls before the system becomes usable. |
| 82 | + |
| 83 | +## Turning Research Into Product Decisions |
| 84 | + |
| 85 | +Teams benefit from applied research when it changes a decision. In Vin |
| 86 | +Vashishta's |
| 87 | +[Monetize Machine Learning]({{ '/podcasts/make-money-with-machine-learning-roles-skills/' | relative_url }}), |
| 88 | +the 43:28 chapter connects product management with researchable use cases. A |
| 89 | +business question has to become a technical hypothesis before researchers can |
| 90 | +test it. The 48:54 chapter adds feasibility studies and gated decisions, which |
| 91 | +keeps research connected to product risk instead of open-ended exploration. |
| 92 | + |
| 93 | +[Loris Marini]({{ '/people/lorismarini/' | relative_url }}) describes a similar |
| 94 | +SaaS case. In |
| 95 | +[Data Professionals Need Business Skills in SaaS]({{ '/podcasts/data-professionals-business-skills-in-saas/' | relative_url }}), |
| 96 | +the 2:45 chapter describes research skills applied in a startup. The 8:30 |
| 97 | +chapter discusses reinforcement learning applied to practical problems. That |
| 98 | +episode ties applied research to stakeholder language and business metrics. It |
| 99 | +also ties the work to model deployment rather than treating research as a |
| 100 | +separate track. |
| 101 | + |
| 102 | +For a data team, applied research should produce a decision-ready answer. The |
| 103 | +team should know whether to continue, stop, or simplify. It should also know |
| 104 | +whether to collect different data, change the metric, or move toward production. |
| 105 | +That connects the topic to |
| 106 | +[experimentation and causal inference]({{ '/wiki/experimentation-and-causal-inference/' | relative_url }}) |
| 107 | +when the main question is evidence quality. It connects to |
| 108 | +[machine learning system design]({{ '/wiki/machine-learning-system-design/' | relative_url }}) |
| 109 | +when the main question is whether the approach can be served reliably. |
| 110 | + |
| 111 | +## Engineering And Reproducibility |
| 112 | + |
| 113 | +The archive repeatedly treats reproducibility as part of applied research, not |
| 114 | +as cleanup after the fact. In |
| 115 | +[From Research to Production]({{ '/podcasts/research-to-production-ml-systems-roadmap/' | relative_url }}), |
| 116 | +[Mihail Eric]({{ '/people/mihaileric/' | relative_url }}) says researchers need |
| 117 | +engineering rigor at the 23:32 chapter. In the 44:36 and 46:57 chapters, he |
| 118 | +recommends end-to-end systems, deployment practice, and code reviews. If no one |
| 119 | +can reproduce the result or run the system, the research can't guide production |
| 120 | +work. |
| 121 | + |
| 122 | +[Johanna Bayer]({{ '/people/johannabayer/' | relative_url }}) makes the same |
| 123 | +argument from academia in |
| 124 | +[Teaching Open Science and Reproducible Research]({{ '/podcasts/teaching-reproducible-research-and-open-science-coding-practices-for-academia/' | relative_url }}). |
| 125 | +At 8:30, she discusses reproducible manuscripts with embedded code. At 12:10 |
| 126 | +and 16:36, she frames research software engineering around software-focused |
| 127 | +research outputs and reusable toolboxes. Her |
| 128 | +discussion connects applied research with [open source]({{ '/wiki/open-source/' | relative_url }}) |
| 129 | +and [software engineering]({{ '/wiki/software-engineering/' | relative_url }}). |
| 130 | + |
| 131 | +[Eleni Tzirita Zacharatou]({{ '/people/elenitziritazacharatou/' | relative_url }}) |
| 132 | +adds a systems-research version in |
| 133 | +[Big Data Analytics and Postdoc Research]({{ '/podcasts/big-data-analytics-and-postdoc-research/' | relative_url }}). |
| 134 | +The 23:08 and 24:15 chapters discuss Nebula Stream and Agora infrastructure. |
| 135 | +They also discuss system-driven research that grows from earlier |
| 136 | +stream-processing systems such as Apache Flink. In that setting, researchers do |
| 137 | +not only produce an insight. They also produce an infrastructure idea that other |
| 138 | +researchers or industry teams can |
| 139 | +evaluate. |
| 140 | + |
| 141 | +## Domain Constraints |
| 142 | + |
| 143 | +The work changes when the deployment domain changes. In |
| 144 | +[Applying Computer Vision Research to Building Production-Ready AI Systems]({{ '/podcasts/from-computer-vision-research-to-autonomous-driving-ai/' | relative_url }}), |
| 145 | +[Aishwarya Jadhav]({{ '/people/aishwaryajadhav/' | relative_url }}) discusses |
| 146 | +sensor tradeoffs at 11:22 and on-vehicle inference at 22:17. She covers model |
| 147 | +compression at 23:28 and staged validation from 29:45 onward. Those constraints |
| 148 | +make the research question more specific than "which model is best?" The team |
| 149 | +has to ask which model works under the product's cost, latency, privacy, and |
| 150 | +safety requirements. |
| 151 | + |
| 152 | +In the same episode, the 51:28 chapter discusses sensitive-case testing and the |
| 153 | +52:53 chapter discusses multimodal LLMs in autonomous-driving contexts. This is |
| 154 | +why applied research often links to [LLM production patterns]({{ '/wiki/llm-production-patterns/' | relative_url }}) |
| 155 | +and [notebook-to-production AI systems]({{ '/wiki/notebook-to-production-ai-systems/' | relative_url }}). |
| 156 | +The research idea has to meet evaluation, rollout, monitoring, and system |
| 157 | +coordination constraints before a team can operate it. |
74 | 158 |
|
75 | 159 | ## Related Pages |
76 | 160 |
|
77 | | -Use these pages for adjacent ML, production, and career material. |
| 161 | +These pages cover the adjacent roles, systems, and practices that appear in the |
| 162 | +same podcast discussions. |
78 | 163 |
|
79 | 164 | - [Machine Learning]({{ '/wiki/machine-learning/' | relative_url }}) |
| 165 | +- [Experimentation]({{ '/wiki/experimentation/' | relative_url }}) |
| 166 | +- [MLOps]({{ '/wiki/mlops/' | relative_url }}) |
80 | 167 | - [Production]({{ '/wiki/production/' | relative_url }}) |
81 | 168 | - [Machine Learning System Design]({{ '/wiki/machine-learning-system-design/' | relative_url }}) |
82 | 169 | - [Academic Researcher to Data Science]({{ '/wiki/academic-researcher-to-data-science/' | relative_url }}) |
83 | | -- [AI]({{ '/wiki/ai/' | relative_url }}) |
84 | | -- [MLOps]({{ '/wiki/mlops/' | relative_url }}) |
| 170 | +- [Computer Vision]({{ '/wiki/computer-vision/' | relative_url }}) |
| 171 | +- [Open Source]({{ '/wiki/open-source/' | relative_url }}) |
0 commit comments