Out of memory and System runs very slow after a while

[halma]

Hi

i try to get TC6.4 x64 to run under xen as a PV DomU with 512MB of Ram, i never had only problem before with my settings as i was playing on TC5.3 x64 on my other maschine.

TC runs from beginnig fast and i try to compile the xen tools source but after a while the system is getting really really slow and sometime it prints "Out of memory:" . I allready had an swapfile added with 1024MB but its doesnt seems to help ...

these are the boot options:

Code: [Select]

extra="console=tty xencons=tty waitusb=5 nortc nodhcp noutc nozswap root=xvda1 home=xvda1 tce=xvda1 opt=xvda1 host=tcdev"
cat /etc/fstab

Code: [Select]

# /etc/fstab
proc            /proc        proc    defaults          0       0
sysfs           /sys         sysfs   defaults          0       0
devpts          /dev/pts     devpts  defaults          0       0
tmpfs           /dev/shm     tmpfs   defaults          0       0
/dev/xvda1      /mnt/xvda1      ext4     noauto,users,exec    0 0 # Added by TC
/dev/xvdb1      none            swap     defaults             0 0 # Added by TC
free -m

Code: [Select]

             total         used         free       shared      buffers
Mem:           494          488            5            0            0
-/+ buffers:                487            6
Swap:         1023            1         1022
uname -a

Code: [Select]

Linux tcdev 3.16.6-tinycore64 #777 SMP Thu Oct 16 10:21:00 UTC 2014 x86_64 GNU/Linux
boot output:

Code: [Select]

Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Initializing cgroup subsys cpuacct
Linux version 3.16.6-tinycore64 (tc@box) (gcc version 4.9.1 (GCC) ) #777 SMP Thu Oct 16 10:21:00 UTC 2014
Command line: console=tty xencons=tty waitusb=5 nortc nodhcp noutc nozswap root=xvda1 home=xvda1 tce=xvda1 opt=xvda1 host=tcdev
ACPI in unprivileged domain disabled
e820: BIOS-provided physical RAM map:
Xen: [mem 0x0000000000000000-0x000000000009ffff] usable
Xen: [mem 0x00000000000a0000-0x00000000000fffff] reserved
Xen: [mem 0x0000000000100000-0x000000001fffffff] usable
Notice: NX (Execute Disable) protection missing in CPU!
DMI not present or invalid.
AGP: No AGP bridge found
e820: last_pfn = 0x20000 max_arch_pfn = 0x400000000
init_memory_mapping: [mem 0x00000000-0x000fffff]
init_memory_mapping: [mem 0x1fe00000-0x1fffffff]
init_memory_mapping: [mem 0x1c000000-0x1fdfffff]
init_memory_mapping: [mem 0x00100000-0x1bffffff]
RAMDISK: [mem 0x01e77000-0x0296cfff]
Zone ranges:
  DMA      [mem 0x00001000-0x00ffffff]
  DMA32    [mem 0x01000000-0xffffffff]
  Normal   empty
Movable zone start for each node
Early memory node ranges
  node   0: [mem 0x00001000-0x0009ffff]
  node   0: [mem 0x00100000-0x1fffffff]
smpboot: Allowing 1 CPUs, 0 hotplug CPUs
PM: Registered nosave memory: [mem 0x000a0000-0x000fffff]
e820: [mem 0x20000000-0xffffffff] available for PCI devices
Booting paravirtualized kernel on Xen
Xen version: 4.5-unstable (preserve-AD)
setup_percpu: NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:1 nr_node_ids:1
PERCPU: Embedded 27 pages/cpu @ffff88001fc00000 s80576 r8192 d21824 u2097152
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 129162
Kernel command line: console=tty xencons=tty waitusb=5 nortc nodhcp noutc nozswap root=xvda1 home=xvda1 tce=xvda1 opt=xvda1 host=tcdev
PID hash table entries: 2048 (order: 2, 16384 bytes)
Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
AGP: Checking aperture...
AGP: No AGP bridge found
Memory: 491784K/523900K available (4911K kernel code, 674K rwdata, 1328K rodata, 928K init, 748K bss, 32116K reserved)
Hierarchical RCU implementation.
CONFIG_RCU_FANOUT set to non-default value of 32
RCU restricting CPUs from NR_CPUS=8 to nr_cpu_ids=1.
RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1
NR_IRQS:4352 nr_irqs:256 16
xen:events: Using FIFO-based ABI
Console: colour dummy device 80x25
console [tty0] enabled
console [hvc0] enabled
installing Xen timer for CPU 0
tsc: Detected 2530.936 MHz processor
Calibrating delay loop (skipped), value calculated using timer frequency.. 5063.78 BogoMIPS (lpj=8436453)
pid_max: default: 32768 minimum: 301
Mount-cache hash table entries: 1024 (order: 1, 8192 bytes)
Mountpoint-cache hash table entries: 1024 (order: 1, 8192 bytes)
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys net_prio
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
Last level iTLB entries: 4KB 128, 2MB 4, 4MB 4
Last level dTLB entries: 4KB 256, 2MB 0, 4MB 32, 1GB 0
tlb_flushall_shift: -1
Freeing SMP alternatives memory: 16K (ffffffff81992000 - ffffffff81996000)
Performance Events: unsupported p6 CPU model 23 no PMU driver, software events only.
x86: Booted up 1 node, 1 CPUs
NET: Registered protocol family 16
xen:grant_table: Grant tables using version 1 layout
Grant table initialized
PCI: setting up Xen PCI frontend stub
ACPI: Interpreter disabled.
xen:balloon: Initialising balloon driver
xen_balloon: Initialising balloon driver
vgaarb: loaded
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
Linux video capture interface: v2.00
PCI: System does not support PCI
PCI: System does not support PCI
Switched to clocksource xen
pnp: PnP ACPI: disabled
NET: Registered protocol family 2
TCP established hash table entries: 4096 (order: 3, 32768 bytes)
TCP bind hash table entries: 4096 (order: 4, 65536 bytes)
TCP: Hash tables configured (established 4096 bind 4096)
TCP: reno registered
UDP hash table entries: 256 (order: 1, 8192 bytes)
UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
NET: Registered protocol family 1
RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
Trying to unpack rootfs image as initramfs...
Freeing initrd memory: 11224K (ffff880001e77000 - ffff88000296d000)
platform rtc_cmos: registered platform RTC device (no PNP device found)
futex hash table entries: 256 (order: 2, 16384 bytes)
NFS: Registering the id_resolver key type
Key type id_resolver registered
Key type id_legacy registered
nfs4filelayout_init: NFSv4 File Layout Driver Registering...
fuse init (API version 7.23)
msgmni has been set to 982
NET: Registered protocol family 38
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
io scheduler noop registered
io scheduler deadline registered (default)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
xen:xen_evtchn: Event-channel device installed
Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
Non-volatile memory driver v1.3
Hangcheck: starting hangcheck timer 0.9.1 (tick is 180 seconds, margin is 60 seconds).
Hangcheck: Using getrawmonotonic().
brd: module loaded
mtip32xx Version 1.3.1
Error creating debugfs parent
zram: Created 1 device(s) ...
VMware PVSCSI driver - version 1.0.5.0-k
libphy: Fixed MDIO Bus: probed
tun: Universal TUN/TAP device driver, 1.6
tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
PPP generic driver version 2.4.2
PPP Deflate Compression module registered
NET: Registered protocol family 24
xen_netfront: Initialising Xen virtual ethernet driver
blkfront: xvda1: flush diskcache: enabled; persistent grants: enabled; indirect descriptors: disabled;
blkfront: xvdb1: flush diskcache: enabled; persistent grants: enabled; indirect descriptors: disabled;
Setting capacity to 16580608
xvda1: detected capacity change from 0 to 8489271296
   ( '>')
  /) TC (\   Core is distributed with ABSOLUTELY NO WARRANTY.
 (/-_--_-\)           www.tinycorelinux.net

usertc@tchost:~$

mount

Code: [Select]

rootfs on / type rootfs (rw)
proc on /proc type proc (rw,relatime)
sysfs on /sys type sysfs (rw,relatime)
devpts on /dev/pts type devpts (rw,relatime,mode=600,ptmxmode=000)
tmpfs on /dev/shm type tmpfs (rw,relatime)
fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime)
/dev/xvda1 on /mnt/xvda1 type ext4 (rw,relatime,data=ordered)
/dev/xvda1 on /home type ext4 (rw,relatime,data=ordered)
/dev/xvda1 on /opt type ext4 (rw,relatime,data=ordered)
/dev/loop0 on /tmp/tcloop/libgpg-error type squashfs (ro,relatime)
/dev/loop1 on /tmp/tcloop/libgcrypt type squashfs (ro,relatime)
/dev/loop2 on /tmp/tcloop/libssh2 type squashfs (ro,relatime)
/dev/loop3 on /tmp/tcloop/pcre type squashfs (ro,relatime)
/dev/loop4 on /tmp/tcloop/libffi type squashfs (ro,relatime)
/dev/loop5 on /tmp/tcloop/glib2 type squashfs (ro,relatime)
/dev/loop6 on /tmp/tcloop/slang type squashfs (ro,relatime)
/dev/loop7 on /tmp/tcloop/mc type squashfs (ro,relatime)
/dev/loop8 on /tmp/tcloop/gcc_libs type squashfs (ro,relatime)
/dev/loop9 on /tmp/tcloop/openssl type squashfs (ro,relatime)
/dev/loop10 on /tmp/tcloop/openssh type squashfs (ro,relatime)
/dev/loop11 on /tmp/tcloop/ncurses type squashfs (ro,relatime)
/dev/loop12 on /tmp/tcloop/readline type squashfs (ro,relatime)
/dev/loop13 on /tmp/tcloop/bash type squashfs (ro,relatime)
/dev/loop14 on /tmp/tcloop/bash-completion type squashfs (ro,relatime)
/dev/loop15 on /tmp/tcloop/libffi-dev type squashfs (ro,relatime)
/dev/loop16 on /tmp/tcloop/expat2 type squashfs (ro,relatime)
/dev/loop17 on /tmp/tcloop/expat2-dev type squashfs (ro,relatime)
/dev/loop18 on /tmp/tcloop/ncurses-dev type squashfs (ro,relatime)
/dev/loop19 on /tmp/tcloop/readline-dev type squashfs (ro,relatime)
/dev/loop20 on /tmp/tcloop/gdbm type squashfs (ro,relatime)
/dev/loop21 on /tmp/tcloop/gdbm-dev type squashfs (ro,relatime)
/dev/loop22 on /tmp/tcloop/tcl type squashfs (ro,relatime)
/dev/loop23 on /tmp/tcloop/tcl-dev type squashfs (ro,relatime)
/dev/loop24 on /tmp/tcloop/tk type squashfs (ro,relatime)
/dev/loop25 on /tmp/tcloop/tk-dev type squashfs (ro,relatime)
/dev/loop26 on /tmp/tcloop/openssl-dev type squashfs (ro,relatime)
/dev/loop27 on /tmp/tcloop/bzip2-lib type squashfs (ro,relatime)
/dev/loop28 on /tmp/tcloop/bzip2 type squashfs (ro,relatime)
/dev/loop29 on /tmp/tcloop/bzip2-dev type squashfs (ro,relatime)
/dev/loop30 on /tmp/tcloop/sqlite3 type squashfs (ro,relatime)
/dev/loop31 on /tmp/tcloop/sqlite3-bin type squashfs (ro,relatime)
/dev/loop32 on /tmp/tcloop/sqlite3-dev type squashfs (ro,relatime)
/dev/loop33 on /tmp/tcloop/python type squashfs (ro,relatime)
/dev/loop34 on /tmp/tcloop/python-dev type squashfs (ro,relatime)
/dev/loop35 on /tmp/tcloop/gettext type squashfs (ro,relatime)
/dev/loop36 on /tmp/tcloop/pcre-dev type squashfs (ro,relatime)
/dev/loop37 on /tmp/tcloop/glib2-python type squashfs (ro,relatime)
/dev/loop38 on /tmp/tcloop/glib2-dev type squashfs (ro,relatime)
/dev/loop39 on /tmp/tcloop/curl type squashfs (ro,relatime)
/dev/loop40 on /tmp/tcloop/git type squashfs (ro,relatime)
/dev/loop41 on /tmp/tcloop/perl5 type squashfs (ro,relatime)
/dev/loop42 on /tmp/tcloop/zlib_base-dev type squashfs (ro,relatime)
/dev/loop43 on /tmp/tcloop/util-linux_base-dev type squashfs (ro,relatime)
/dev/loop44 on /tmp/tcloop/linux-3.16.2_api_headers type squashfs (ro,relatime)
/dev/loop45 on /tmp/tcloop/gcc_base-dev type squashfs (ro,relatime)
/dev/loop46 on /tmp/tcloop/glibc_base-dev type squashfs (ro,relatime)
/dev/loop47 on /tmp/tcloop/e2fsprogs_base-dev type squashfs (ro,relatime)
/dev/loop48 on /tmp/tcloop/sed type squashfs (ro,relatime)
/dev/loop49 on /tmp/tcloop/pkg-config type squashfs (ro,relatime)
/dev/loop50 on /tmp/tcloop/patch type squashfs (ro,relatime)
/dev/loop51 on /tmp/tcloop/make type squashfs (ro,relatime)
/dev/loop52 on /tmp/tcloop/m4 type squashfs (ro,relatime)
/dev/loop53 on /tmp/tcloop/grep type squashfs (ro,relatime)
/dev/loop54 on /tmp/tcloop/gmp type squashfs (ro,relatime)
/dev/loop55 on /tmp/tcloop/mpfr type squashfs (ro,relatime)
/dev/loop56 on /tmp/tcloop/mpc type squashfs (ro,relatime)
/dev/loop57 on /tmp/tcloop/gcc_libs-dev type squashfs (ro,relatime)
/dev/loop58 on /tmp/tcloop/isl type squashfs (ro,relatime)
/dev/loop59 on /tmp/tcloop/cloog type squashfs (ro,relatime)
/dev/loop60 on /tmp/tcloop/binutils type squashfs (ro,relatime)
/dev/loop61 on /tmp/tcloop/gcc type squashfs (ro,relatime)
/dev/loop62 on /tmp/tcloop/gawk type squashfs (ro,relatime)
/dev/loop63 on /tmp/tcloop/flex type squashfs (ro,relatime)
/dev/loop64 on /tmp/tcloop/findutils type squashfs (ro,relatime)
/dev/loop65 on /tmp/tcloop/file type squashfs (ro,relatime)
/dev/loop66 on /tmp/tcloop/diffutils type squashfs (ro,relatime)
/dev/loop67 on /tmp/tcloop/bison type squashfs (ro,relatime)
/dev/loop68 on /tmp/tcloop/compiletc type squashfs (ro,relatime)
/dev/loop69 on /tmp/tcloop/squashfs-tools type squashfs (ro,relatime)
/dev/loop70 on /tmp/tcloop/glibc_apps type squashfs (ro,relatime)
/dev/loop71 on /tmp/tcloop/autoconf type squashfs (ro,relatime)
/dev/loop72 on /tmp/tcloop/pixman type squashfs (ro,relatime)
/dev/loop73 on /tmp/tcloop/pixman-dev type squashfs (ro,relatime)
/dev/loop74 on /tmp/tcloop/texinfo type squashfs (ro,relatime)
/dev/loop75 on /tmp/tcloop/libarchive type squashfs (ro,relatime)
/dev/loop76 on /tmp/tcloop/cmake type squashfs (ro,relatime)
/dev/loop77 on /tmp/tcloop/grub2 type squashfs (ro,relatime)
something missing to post ?
hope someone has an idea to get the system stable ..
thanks

[gerald_clark]

Make sure your source directory is on persistent storage, not on the RAM filesystem.

[halma]

Make sure your source directory is on persistent storage, not on the RAM filesystem.

Hi Gerald, sorry what exactly do you mean with source directory ? you mean rootfs ?
thanks

[Rich]

Hi halma
The directory that contains the source files you are trying to compile.

[halma]

Hi Rich,

the sources/source code of xen4tools is placed under /mnt/xvda1/tinycorelinux but my extension creator script puts all sources to /tmp and do the work under /tmp/tempfolder

if i am doing a df -hm /tmp show me this:
df -hm /tmp/

Code: [Select]

Filesystem                Size      Used Available Use% Mounted on
rootfs                       0         0         0   0% /
ok let me try to work allways in /mnt/xvda1/tmp ....lets see
thanks

[gerald_clark]

/tmp is in the RAM filesystem.  You are running out of RAM.
You need to fix your script to not build in /tmp.