"which implies that he doesn't consider the workers relevant in a description of Minbari society or culture."

Or that JMS hadn't made up the three caste structure yet.

They are certainly equal members of the Grey Council by S2.