Well it turns out it was my clutch adjustment rod. I messed with it like crazy this weekend, added a double nut to it and it has been working fine since. It kept pulling itself out of adjustment. Anyway I was happy to find out it wasn't anything major.