Tiny Core Linux

General TC => Tiny Core on Virtual Machines => Topic started by: deodion on August 17, 2017, 03:05:17 PM

Title: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 17, 2017, 03:05:17 PM
I see if I install Xorg-7.7.tcz Memory usage is high in TCL 8.0 x64,

Memory usage become high, like 600-700 MB in idle,

While Coreplus 8.0 only takes 25 MB,

I need to use TCL 8.0 x64 with lowest resource possible,

I'm guessing because of optimized extension in Coreplus?

Thank you,
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: andyj on August 17, 2017, 03:24:29 PM
That's a lot. What extensions do you have loaded?
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 17, 2017, 09:56:47 PM
As i said. Only that xorg...
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: Rich on August 17, 2017, 10:04:16 PM
Hi deodion
Run  top  and see what it says is consuming memory.
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 18, 2017, 12:04:03 AM
From fresh TCL 8.0 x64
Run App and booton tc-install-gui.tcz and run it,
reboot to hdd
failed in waitforX

tce-load -wi Xorg-7.7.tcz

Result attached in .PNG with assigned VM memory:
256 MB.png
512 MB.png

May be I just need to follow:
Your hardware list isn't required, because all VMware VM's have the same virtual hardware for a given version. In onboot.lst all you should need is:

Code: [Select]
open-vm-tools-desktop.tcz
Xlibs.tcz
Xprogs.tcz
flwm_topside.tcz
wbar.tcz
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 18, 2017, 12:26:02 AM
Result attached in .PNG with assigned VM memory:
1 GB.png
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: curaga on August 18, 2017, 03:58:59 AM
(http://i.imgur.com/eyGDg9B.png)
This is in Qemu, TC 8.0 x64, with 128mb RAM. The extensions (17mb) are in RAM too here, not disk. It wasn't enough to start Xorg, but 256mb was - but even at 128mb, the system was nowhere close to out of memory in the console, like in your 256mb and 512mb pics.

So, I think it's something else that's taking that 400mb of RAM. Could it be you enabled copy2fs (installing extensions to RAM)?
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 18, 2017, 04:14:56 AM
Hello, thanks for replying,

as I said, its from fresh TCL 8.0 x64 .ISO, I copy again below the steps I took:

From fresh TCL 8.0 x64
Run App and booton tc-install-gui.tcz and run it,
reboot to hdd
failed in waitforX
tce-load -wi Xorg-7.7.tcz


so there is no other extension I run or download,
may be to make it more clear: I use HP ML350 G6 + ESXi 5.5, vCenter SA 5.5, 2 x 1TB in RAID 1, 16 GB RAM,

And also as you may notice, I'm OK with Coreplus 8.0, and if I use top, If I remember from my host in home: I see Xvesa loaded,

So its like a:
with Xorg: RAM eats 700 MB, storage 1+ GB,
with Coreplus 8.0 without anything, just install the VM, RAM eats 25 MB, storage 400 MB,


both scenario uses the same VM settings, for example: 1 x CPU enable hot add, RAM 256 enable hot add, VMware Paravirtual SCSI, CD for ISO, standard display, ...

I really just need a TCL x64 VM with standard initial setup/configuration, such as:
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: andyj on August 18, 2017, 07:18:04 AM
I have two ESXi 6.0 servers. One has my TC 8.x dev VM, which can dual boot as either 32-bit or 64-bit system. How are you accessing the console? Are use using the web browser interface (not recommended), the VMware workstation connected to the remote server interface (works best), or vSphere? There is no pre-built install for VMtools for TC, that's what open-vm-tools-desktop is for. I use copy2fs because for development I may have over 300 extensions loaded. At boot there are 114, using just over 110 MB of RAM.

I can't reproduce your memory problem. Can you post your onboot.lst file?
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 18, 2017, 07:58:11 AM
I use vcenter 5.5 and access it via vSphere web client, and with help of VMware Workstation for viewing the console VM (clickable from web client)

Later tonight I will provide ur request,

I notice if I install open-vmware-tools-desktop.tcz it will include all necessary files, last time I try, got MD5 error for a file.
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 18, 2017, 11:48:14 AM
Hello Andyj,

Here you go your requests,

Btw what if I kill the PID eating the RAM?
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 18, 2017, 12:12:39 PM
I successfully try to reinstall fresh TCL 8.0 x64 with VMware Tools (set RAM 1 GB first),
The top command looks different,

when I set to 256 MB, display simply wont start,
with 384 MB, 512 MB, attached pic,

with 1 GB, it starts.
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 18, 2017, 12:17:44 PM
1 GB with VMware Tools installed.

is working, but it takes 70% of 1 GB idle RAM?
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 18, 2017, 12:36:08 PM

So its like a:
with Xorg: RAM eats 700 MB, storage 1+ GB,
with Coreplus 8.0 without anything, just install the VM, RAM eats 25 MB, storage 400 MB,


both scenario uses the same VM settings, for example: 1 x CPU enable hot add, RAM 256 enable hot add, VMware Paravirtual SCSI, CD for ISO, standard display, ...

Please ignore about the storage usage, after I use df -h, it looks like there is no problem,
but ESXi 5.5 reports high storage usage, may be thats how it is from its angle,

So back to RAM usage, is this the real deal? minimum RAM 1 GB? for TCL 8.0 x64
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: andyj on August 18, 2017, 03:03:36 PM
Remember to watch the resident size, not the virtual size. Plus there are file system buffers and cache.

 Here's what my syslog server uses, which include a PostgreSQL database instance:

Code: [Select]
$ free
              total        used        free      shared  buff/cache   available
Mem:        1023668       67668       21148      201616      934852      718232
Swap:             0           0           0

Here's a web server running PHP and Nginx:

Code: [Select]
$ free
              total        used        free      shared  buff/cache   available
Mem:        2055516      111708     1704856      128244      238952     1617132
Swap:             0           0           0

Of course, servers don't run X so the memory usage is a lot less. For a desktop VM running X, I have this:

Code: [Select]
$ free
              total        used        free      shared  buff/cache   available
Mem:        4046148      131240     3614752      205000      300156     3440676
Swap:             0           0           0

which is only a little more. The problem I have is that I seem to have allocated way more memory than the server VM's need. Are you sure you have a problem?
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 18, 2017, 06:28:31 PM
So assuming this is all normal, how can I disable X?

Dont u think its kind of too big, I mean 32 and 64 bit ram requirement?
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: andyj on August 18, 2017, 06:44:27 PM
The easiest way is not to load it in the first place. A server VM only needs open-vm-tools.tcz and the extensions for the services you want to run. Then when you connect to the VM console you get a text console instead.
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 18, 2017, 08:45:41 PM
Do I really need vmware tools if Im gonna run it by console only (core iso)?

Whats its function in TCL context?
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: andyj on August 18, 2017, 10:10:45 PM
VMtools will do time sync, let you gracefully shutdown the VM (stop databases, etc), pass guest status back to the ESXi host, and get host status from within the VM. In VMware workstation you could also mount host folders and copy/paste to/from the host.
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: curaga on August 19, 2017, 05:21:56 AM
Dont u think its kind of too big, I mean 32 and 64 bit ram requirement?
We couldn't reproduce your RAM issue. From what I see, it is not too big, Xorg running with 256mb and Xvesa running with 64mb or even less.
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: Juanito on August 19, 2017, 05:44:26 AM
..and you could try Xfbdev
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 19, 2017, 09:40:53 AM
Dont u think its kind of too big, I mean 32 and 64 bit ram requirement?
We couldn't reproduce your RAM issue. From what I see, it is not too big, Xorg running with 256mb and Xvesa running with 64mb or even less.

Thanks for your support,
May be if you need to remote my VM, you can tell me,
I will rebuild it, you can tell me how to do it, in the VM part,
I will configure my router to accept SSH connection to this VM,
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: Rich on August 19, 2017, 09:42:56 AM
Hi deodion
Your  onboot.lst  file doesn't look right to me:
(http://forum.tinycorelinux.net/index.php?action=dlattach;topic=21315.0;attach=4807)

For example, here is the dependency tree for  Xprogs.tcz:
Code: [Select]
Xprogs.tcz
   Xlibs.tcz
      libXfont.tcz
         freetype.tcz
         libfontenc.tcz
      libXi.tcz
         libXext.tcz
      libXmu.tcz
      libXpm.tcz
         libX11.tcz
            libxcb.tcz
      libXrandr.tcz
         libXext.tcz
         libXrender.tcz
            libX11.tcz
               libxcb.tcz
   fltk-1.3.tcz
   imlib2-bin.tcz
You have everyone of its dependencies listed as onboot. Dependencies are resolved automatically and should not be listed
in  onboot.lst.

I also see you have  Xfbdev.tcz  listed in addition to  Xorg-7.7.tcz.  You should probably only load one of those.
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: deodion on August 19, 2017, 09:56:48 AM
Hello Rich,
Thanks for your comment,

I'm just end-user of this TCL with basic Linux skill,
and I explained what I did, pretty much simple and nothing fancy,
just install, and thats it,

no other fancy-things I did before producing the unexpected RAM issue,
just straightforward, create vm, Paravirtual, VMXNET 3, enable cpu/ram hot add, load iso, tc-install-GUI, tce-load Xorg-7.7

tce-load open-vm-tools-desktop.tcz also produces the same RAM consumption,

but at the moment I just use Core8.0 x64, just installed it successfully,
and for my personal case, the need to have desktop just use Tiny Core 8.0 x86,
Title: Re: Installing TCL 8.0 x64 with Xorg-7.7.tcz Memory usage is high
Post by: andyj on August 19, 2017, 11:24:57 AM

May be I just need to follow:
Your hardware list isn't required, because all VMware VM's have the same virtual hardware for a given version. In onboot.lst all you should need is:

Code: [Select]
open-vm-tools-desktop.tcz
Xlibs.tcz
Xprogs.tcz
flwm_topside.tcz
wbar.tcz

Yes, you should follow what I said. If you don't, what do you think I'm going to recommend you do?