Can I sue if I was singled out and fired from my job?

The key word in your question is "contract". You are a contractor, not an employee. Once your contract is up, they are not obligated to renew it and they are not obligated to provide you a reason.