How can I make my computer more fast and efficient ...?

[oleg]

Hello,
my new computer based on CPU Intel® Core™ i7-3930K and motherboard Asus P9X79 WS.

How can I make my computer more fast and efficient for THELI?

RAID0 on 4 x SATA 3Gb/s port or
2 x SATA 6Gb/s ports.
What will be better in my case?

Regards,
Oleg

[Knickohr]

Hi Oleg,

as much RAM as possible.

Thomas

[oleg]

Hi Thomas,

I want to increase the RAM from 16GB to 32/64GB in any case.
But one 2TB HDD not enough... It works without rest

Oleg

[Knickohr]

Hi,

yes, one 2TB HDD is not enough. Not enough at all, if you do some Allsky's with 40.000x20.000 pixels

I use 5x 2TB HDDs and some small ones. One 2TB is for the raw-Data, the other 4 are in an raid-5 (3x2TB with parity). A 270GB is for temporary (Theli-Temp) and a 80GB is for the OS with the Theli application.

Thomas

[oleg]

Hmmm...

I planned 4x1TB HDD (Western Digital RE4 1TB 7200rpm 64MB WD1003FBYX 3.5" SATA II) for RAID0, one 3TB HDD for raw data and 120GB...256 GB SSD for OS Ubuntu.

[Knickohr]

Hmmm ...

you don't need the SSD, if you have 64GB RAM

What's your target with this "big" machine ? Creating monster-panoramas or allskies, like I do ?

Thomas

[oleg]

Maybe you're right

Yes, I want to process a big astrophoto and create panoramas.

[Knickohr]

Think big !

Use the max. RAM, that the motherboard supports and use big HDDs.

Thomas

[oleg]

So, I have increased the RAM to 64 GB (freq. 1600MHz) and composed the RAID0 from 2HDDx2TB SATAIII.
But it is not enough, because the RAID0 writes too slowly...

Any ideas?

[Knickohr]

ooopsss ?!

I scamp 5000 images in 2 hours and swarp it in about 1 night to a 40k x 20k Allsky (one color).

Any error messages or only slow ?

Thomas

[oleg]

only slow

And look at this picture:
Історія ЦП - CPU History
Пам’ять - RAM

[Knickohr]

Yes Oleg,

this is an CPU-wasting process. How long does it takes ? Ans how many pictures ?

Open an terminal :

# top

press SHIFT+M

and show me the table

Thomas

[oleg]

this is an CPU-wasting process. How long does it takes ? Ans how many pictures ?

How long...?
About 2-3 hours...
3880 fits (size: 2kpx x 4kpx)

[Knickohr]

Its all OK

Normal math of scamp.

You use an 1.6HGHz ? I use an 3.0Ghz

Normal processing ... please hold the line

Thomas

[mischa]

How long...?
About 2-3 hours...
3880 fits (size: 2kpx x 4kpx)

Nothing unusual there... resampling is mostly a CPU-intensive job, and not (or only very little) I/O limited with your RAID solution.
You can see that by the simple fact that all your CPUs are close to maxed out. You just have to wait...

mischa