It’s just not comparable to having to memorize arbitrary gender for every noun in the language

Yes, instead of having to memorize one of up to three possible genders for every noun, you only have to memorize an infinity of arbitrary pronunciations for every word.
Much easier.