Told I owe money back on my benefits

I received a letter saying I was overpaid about $500 on my claim. I have read a lot of threads here and could not find my exact situation. The letter mentions an appeal window and a repayment plan. Who should I talk to first?

Keep everything in writing and save the confirmation numbers. It saved me later.