Of course everybody memorizes the Cmaj key as his name , try to have this as your basic scale (no flats or sharps) , all other keys will have some sharps or flats ... If you learned the cycles of fifth and fourth it would be easier ... Then you can easily identify modes after knowing your keys .

And yeah , it's all about repetition ... By time , you'll make your own patterns.