WelcomeWelcome | FAQFAQ | DownloadsDownloads | WikiWiki

Author Topic: How does memory management work?  (Read 5009 times)

Offline naf456

  • Newbie
  • *
  • Posts: 11
    • Humbell
How does memory management work?
« on: January 30, 2013, 11:58:35 AM »
Hello, Nathan here.

Totally in love with TC at the mo. Have my graphics all set up and my sound working.

I'm curious to how TC manages memory , if the root FS is loaded in RAM does that mean all files saved to root FS is loaded in the ram also?

for example I have got xonotic up and running , however chrome saved it to downloads initially - and thats when my RAM usage went through the roof.
I have moved it to the disk I have got TC installed now , and so the ram is much less.



“Twenty years from now you will be more disappointed by the things that you didn’t do than by the ones you did do. So throw off the bowlines. Sail away from the safe harbor. Catch the trade winds in your sails. Explore. Dream. Discover" - Mark Twain

Offline tinypoodle

  • Hero Member
  • *****
  • Posts: 3857
Re: How does memory management work?
« Reply #1 on: January 30, 2013, 10:45:02 PM »
tmpfs (using RAM + swap) is mounted over /.
Any other filesystem can be accessed through its mount point.
"Software gets slower faster than hardware gets faster." Niklaus Wirth - A Plea for Lean Software (1995)

Offline naf456

  • Newbie
  • *
  • Posts: 11
    • Humbell
Re: How does memory management work?
« Reply #2 on: January 31, 2013, 02:02:23 AM »
Yeah - but the core filesystem is "Virtual" - meaning that it only exists in ram , because on HDD it's actually an archive.

How can you save something to "~/Downloads" on the HDD when it doesn't exist - only in the RAM.
Download Xonotic to RAM lol.

Or does it - is "~/" inflated at boot? ie is it on the HDD? erh... so confused. too early in the morning ^_^
“Twenty years from now you will be more disappointed by the things that you didn’t do than by the ones you did do. So throw off the bowlines. Sail away from the safe harbor. Catch the trade winds in your sails. Explore. Dream. Discover" - Mark Twain

Offline althalus

  • Sr. Member
  • ****
  • Posts: 351
Re: How does memory management work?
« Reply #3 on: January 31, 2013, 03:08:56 AM »
Options:
1. Download everything to an external drive, instead of ~/
2. Use TC's built in backup features
3. Set up a persistent home

Spend some time reading the information on the tinycore website, and on the wiki to find out more. TC is different enough from most other linuxes that the wiki and the website should probably be treated as required reading before getting started.

Offline tinypoodle

  • Hero Member
  • *****
  • Posts: 3857
Re: How does memory management work?
« Reply #4 on: January 31, 2013, 03:48:58 AM »
The content of the initrd cpio archive gets extracted into initramfs (a special instance of tmpfs in case of TC - using shared mem as storage space) at boot time.
"Software gets slower faster than hardware gets faster." Niklaus Wirth - A Plea for Lean Software (1995)

Online Rich

  • Administrator
  • Hero Member
  • *****
  • Posts: 11221
Re: How does memory management work?
« Reply #5 on: January 31, 2013, 08:13:01 AM »
Hi naf456
The file system is basically all in RAM, however, not everything that gets attached to the file system has to be RAM
based. For example:
/mnt refers to RAM
/mnt/sda1 refers to RAM
If I execute:
Code: [Select]
mount /mnt/sda1/mnt/sda1 now refers to drive sda1 and anything copied to /mnt/sda1 goes to the root directory of that drive.
If I now execute:
Code: [Select]
umount /mnt/sda1/mnt/sda1 now refers to RAM again and anything copied to /mnt/sda1 goes to RAM.
If you don't wish to setup a persistent home, you could setup a persistent downloads directory instead and have
Chrome default to that directory.

Offline tinypoodle

  • Hero Member
  • *****
  • Posts: 3857
Re: How does memory management work?
« Reply #6 on: January 31, 2013, 12:16:18 PM »
Options:
1. Download everything to an external drive, instead of ~/
Besides from that, it is also a good idea to configure web browsers so they couldn't use huge amounts of tmpfs space for cache etc.
Also, having generous swap space available whenever possible.
"Software gets slower faster than hardware gets faster." Niklaus Wirth - A Plea for Lean Software (1995)

Offline vinnie

  • Hero Member
  • *****
  • Posts: 1187
  • HandMace informatic works
Re: How does memory management work?
« Reply #7 on: February 01, 2013, 03:39:21 PM »
I also have a question of this type:
As is explained in canonically informatic courses the programs before they are executed by the processor are loaded in ram in a load phase.
in tinycore the programs are already installed in ram, then what happens? are loaded again in ram 2 times or not?

Offline gerald_clark

  • TinyCore Moderator
  • Hero Member
  • *****
  • Posts: 4254
Re: How does memory management work?
« Reply #8 on: February 01, 2013, 04:01:32 PM »
The programs are not installed in RAM.  The extensions are loop mounted into the filesystem.  They are then loaded from from disk/flash-drive to RAM for execution.
They may also reside in cache for a while, but that could be flushed at any time.

If you use copy2fs flag or list,  there will be a copy of the extension in the RAM based filesystem, but it will still need to be loaded into RAM for execution.  In this case, there will be 2 copies of a progam in RAM, and temporarily a third temporary copy in cache.  This is a good reason not to use copy2fs on systems without a lot of RAM.

Offline curaga

  • Administrator
  • Hero Member
  • *****
  • Posts: 10962
Re: How does memory management work?
« Reply #9 on: February 02, 2013, 04:06:31 AM »
IIRC tmpfs doesn't cause that kind of double copy: http://lkml.indiana.edu/hypermail/linux/kernel/0705.0/0940.html
The only barriers that can stop you are the ones you create yourself.

Offline gerald_clark

  • TinyCore Moderator
  • Hero Member
  • *****
  • Posts: 4254
Re: How does memory management work?
« Reply #10 on: February 02, 2013, 06:54:07 AM »
Thanks.
Corrected:  there will not be a 3rd temporary copy in cache.

Offline vinnie

  • Hero Member
  • *****
  • Posts: 1187
  • HandMace informatic works
Re: How does memory management work?
« Reply #11 on: February 03, 2013, 02:44:51 AM »
Thanks gerald, concise and comprehensive as usual.
I use the flag copy2fs so I have 2 copies.
A question yet, but copy2fs also has effect on the scm packages?

Offline naf456

  • Newbie
  • *
  • Posts: 11
    • Humbell
Re: How does memory management work?
« Reply #12 on: February 04, 2013, 05:36:36 AM »
So to clarify - every program/library/resource loaded into the operating system is loaded into the RAM - so TC is kinda crippled if you want to run something like Photoshop (if it were possible) or some other large program?

I tried to run TCX in a virtual machine with 400MHz CPU cap with 64MB or RAM (simulating that of an old laptop) - it pretty much crashed - which was to be expected - yet with 512MB - Even 256MB of ram it ran fairly stable, albeit slow.

What is also blurry is how the applications get extracted from there squash file system? where are they extracted to, in RAM or on disk?

I'm still researching and learning about Linux and Unices, but I still have tons to learn still.

tonight I'll look through some of the scripts and check out how things tick.

still find it pretty cool playing Xonotic on ultra with no considerable frame rate drops like I get in windows or ubuntu XD

 
“Twenty years from now you will be more disappointed by the things that you didn’t do than by the ones you did do. So throw off the bowlines. Sail away from the safe harbor. Catch the trade winds in your sails. Explore. Dream. Discover" - Mark Twain

Offline vinnie

  • Hero Member
  • *****
  • Posts: 1187
  • HandMace informatic works
Re: How does memory management work?
« Reply #13 on: February 04, 2013, 06:37:26 AM »
No, they are all copied completely in ram only if you use the flag copy2fs.flg or the command tce-load -ic or a file to specify programs to be copied entirely in RAM.
Otherwise, access is from a mass storage memory.
The main advantage is that you can umount the mass storage memory  if you copied all the extensions in ram (with the flag).

Online Rich

  • Administrator
  • Hero Member
  • *****
  • Posts: 11221
Re: How does memory management work?
« Reply #14 on: February 04, 2013, 06:47:16 AM »