Metrics
precision@k, recall@k, NDCG, MAP, AUC, log loss, calibration, and grouped metrics.
Machine learning coding practice
A focused lab for metrics, losses, feature pipelines, retrieval, ranking, and debugging utilities.
def precision_at_k(labels, scores, k):
order = sorted(range(len(scores)), key=scores.__getitem__, reverse=True)
top_k = order[:k]
return sum(labels[i] for i in top_k) / max(k, 1)
Tracks
precision@k, recall@k, NDCG, MAP, AUC, log loss, calibration, and grouped metrics.
Binary cross entropy, softmax CE, pairwise ranking loss, focal loss, sampling, and IPS weighting.
Mini-batches, normalization, categorical encoding, padding, time windows, dedupe, and time splits.
Top-k heaps, cosine similarity, nearest neighbors, inverted indexes, BM25, and reranker interfaces.
Dataset comparison, null and drift checks, feature distributions, segment labels, calibration buckets, and confusion matrices.
Starter Problems
Roadmap
The first production milestone is a Python editor, public and hidden tests, user progress, and a curated set of 30 interview-grade ML coding exercises.