Hello there, it sounds like a php.ini problem more than a memory problem that you are referring to. you can do this by working with your hosting provider or creating a "php.ini" file with the following content in it.
memory_limit = 64MB
Then save that file as “php.ini” in your “wp-admin” folder and upload.