Hello there,
That may be due to your plugins or theme consuming the memory in background.First of all remove all the plugins from plugin folder and check if memory still consumes and if required then also switch the theme to default wordpress themes.
Thanks.