We introduce MLE-bench, a benchmark for measuring how well AI agents perform at machine learning engineering.