Do I need to count calories on the non-fast day?

Yes. At least to start with. Once you get used to eating the right amount for your TDEE (total daily energy expenditure), you’ll be able to ease up on counting, but it’s a good idea to count calories even on your non-fast day so that you can ensure you’re not going overboard, especially in the early stages.