Hey there!

Yes you can give upsc after pursuing a bachelor's degree as it is key that you have a degree to pursue upsc. It doesn't really matter where the degree is from, it should be a legit three or four years bachelor's course for you to appear the upsc examination. People tend to get a degree in arts in order to prepare for upsc because they find it easier that way.