Results for "leakage detection"
When information from evaluation data improperly influences training, inflating reported performance.
Recovering training data from gradients.
Extracting system prompts or hidden instructions.
Detects trigger phrases in audio streams.
Separating data into training (fit), validation (tune), and test (final estimate) to avoid leakage and optimism bias.
Identifying and localizing objects in images, often with confidence scores and bounding rectangles.
Identifying suspicious transactions.
Identifying abrupt changes in data generation.
Inferring sensitive features of training data.
AI focused on interpreting images/video: classification, detection, segmentation, tracking, and 3D understanding.
Pixel-level separation of individual object instances.
Of predicted positives, the fraction that are truly positive; sensitive to false positives.
Of true positives, the fraction correctly identified; sensitive to false negatives.
Of true negatives, the fraction correctly identified.
Networks using convolution operations with weight sharing and locality, effective for images and signals.
Automated detection/prevention of disallowed outputs (toxicity, self-harm, illegal instruction, etc.).
When some classes are rare, requiring reweighting, resampling, or specialized metrics.
Maliciously inserting or altering training data to implant backdoors or degrade performance.
Observing model inputs/outputs, latency, cost, and quality over time to catch regressions and drift.
Combining signals from multiple modalities.
Hidden behavior activated by specific triggers, causing targeted mispredictions or undesired outputs.
Pixel motion estimation between frames.
Assigning labels per pixel (semantic) or per instance (instance segmentation) to map object boundaries.
Identifying speakers in audio.
Low-latency prediction per request.
Process for managing AI failures.
External sensing of surroundings (vision, audio, lidar).
Software simulating physical laws.
High-fidelity virtual model of a physical system.
Detecting and avoiding obstacles.