Build an eval harness for local models served by Ollama
A take-home of about four hours (AI coding tools allowed): write an evaluation harness that runs a set of test cases against language models served locally through Ollama, scores the outputs and reports the results.
MercorTechnical phone screenNo answer yet. Write the first one; the best answer gets endorsed.