Difficulty: Intermediate
Identifying abrupt changes in data generation.
Scaling law optimizing compute vs data.
Breaking documents into pieces for retrieval; chunk size/overlap strongly affect RAG quality.
Automated testing and deployment processes for models and data workflows, extending DevOps to ML artifacts.
When some classes are rare, requiring reweighting, resampling, or specialized metrics.
AI systems assisting clinicians with diagnosis or treatment decisions.
Testing AI under actual clinical conditions.
Joint vision-language model aligning images and text.
Models accessible only via service APIs.
Startup latency for services.
Declining differentiation among models.
A theoretical framework analyzing what classes of functions can be learned, how efficiently, and with what guarantees.
Hardware resources used for training/inference; constrained by memory bandwidth, FLOPs, and parallelism.
Regulating access to large-scale compute.
Increasing model capacity via compute.
AI focused on interpreting images/video: classification, detection, segmentation, tracking, and 3D understanding.
Automated assistance identifying disease indicators.
The relationship between inputs and outputs changes over time, requiring monitoring and model updates.
Probabilistic graphical model for structured prediction.
A hidden variable influences both cause and effect, biasing naive estimates of causal impact.
A table summarizing classification outcomes, foundational for metrics like precision, recall, specificity.
Optimization under equality/inequality constraints.
Techniques to handle longer documents without quadratic cost.
Maximum number of tokens the model can attend to in one forward pass; constrains long-document reasoning.
Mathematical framework for controlling dynamic systems.
Algorithm computing control actions.
Optimization problems where any local minimum is global.
Networks using convolution operations with weight sharing and locality, effective for images and signals.
Designing AI to cooperate with humans and each other.
Assigning AI costs to business units.