The interview process was long and intensive. Screening call, and then a more senior team member for a high-level experience overview. I then was moved on to a third round where I had to do a pretty lengthy take home assignment, involving building a model based off of a couple data sources provided, outlining an overview of LLM evaluation, and then making a detailed presentation. They said the assignment should take only a few hours, but realistically to put in some quality work, you’d need at least 10 - 15 hrs. It was then turned in, and then they would decide if it was good enough to move on and present (this should have been the first red flag! spending this much time on free work for the company should automatically warrant a presentation, IMO). I moved on to present and the team had nothing but positive feedback about my presentation and felt that I bonded well with the panel. I moved on to what I think was the final round which was a 1 on 1 with the hiring manager. My biggest complaint is throughout the process it was really hard to get in contact with anyone regarding questions or check ins on timeline. After my final interview, I had sent a couple follow ups before finally receiving a sort of automated rejection. I was more disappointed about not receiving any feedback after all of the work put in on why I didn’t get the job than I was about not actually getting the job. It is a pretty disappointing and frustrating process. I think they really need to be better about communication and getting real feedback for candidates. It definitely turned me off to the company when I was initially really excited about the opportunity.

The process involved a coding challenge, phone screen, and hiring manager interview from what I saw. Between the coding challenge and phone screen I probably spent about 3 hours collectively on the interview only to finally speak to the hiring manager and find out she was nearly completely disinterested. She asked me almost no questions and gave me minimal information to my own questions. I felt like I wasn't even being considered from the beginning, and expectedly I was soon thereafter rejected. Ultimately, this felt extremely disrespectful of my time. Would not recommend completing the coding test without speaking with the hiring manager for this reason.