Both A- and B-sides should be counted for. But only singles that had a commercial release in at least the US, the UK or it's home country. If the single wasn't released prior to the artist's following studio album it should not be counted for either (for example if a track from Revolver was released as a single after Sgt Pepper came out it wouldn't be listed as a single).
