What can you say about multithreading in THELI GUI?

Wie arbeite ich mit Theli, wie verarbeite ich in Theli erstellten Bilder ?
Forumsregeln
Bitte die Beiträge kurz fassen, so kann man sie nachher besser finden. Sollte ein Problem gelöst sein, dann einen neuen Beitrag eröffnen. Ebenso wenn die Ursache eine ganz andere ist, oder es Offtopic wird.

What can you say about multithreading in THELI GUI?

Beitragvon oleg » Dienstag 23. Februar 2016, 17:41

Hi all,
what can you say about multithreading in THELI GUI?
Ubuntu 14.04 64-bit (CPU Intel® Core™ i7-3930K, RAM 64GB, RAID0: 6x1TB).
oleg
 
Beiträge: 85
Registriert: Samstag 1. Oktober 2011, 18:00
Wohnort: Portugal

Re: What can you say about multithreading in THELI GUI?

Beitragvon mischa » Dienstag 23. Februar 2016, 18:23

Hi Oleg,

I'm not sure what you mean? When reducing data from a single-chip camera, then only some processes are multi-threaded, such as astrometry, sky modeling and coaddition. If you reduce data from a multi-chip camera, then the data from the chips will be equally distributed amongst the available CPUs.

mischa
mischa
Moderator
 
Beiträge: 1266
Registriert: Freitag 7. Oktober 2011, 14:07
Wohnort: Chile

Re: What can you say about multithreading in THELI GUI?

Beitragvon oleg » Dienstag 23. Februar 2016, 19:08

I say about the multi-chip cameras data processing.

Look at my screenshots from OmegaCam@VST data processing:

step #1
Bild

step #2
Bild

step #3
Bild

step #4
Bild
Zuletzt geändert von oleg am Dienstag 23. Februar 2016, 19:17, insgesamt 1-mal geändert.
Ubuntu 14.04 64-bit (CPU Intel® Core™ i7-3930K, RAM 64GB, RAID0: 6x1TB).
oleg
 
Beiträge: 85
Registriert: Samstag 1. Oktober 2011, 18:00
Wohnort: Portugal

Re: What can you say about multithreading in THELI GUI?

Beitragvon oleg » Dienstag 23. Februar 2016, 19:16

I have the question about step #3 (or Coaddition: coadding images...) in menu "Coaddition".

Why does this step use so small powerful of CPU/threads??? :?

CPU1 7.9% CPU2 7.9% CPU3 3.9% CPU4 3.0%
CPU5 6.0% CPU6 10.7% CPU7 2.0% CPU8 0.0%
CPU9 6.8% CPU10 2.0% CPU11 2.0% CPU12 2.0%
Ubuntu 14.04 64-bit (CPU Intel® Core™ i7-3930K, RAM 64GB, RAID0: 6x1TB).
oleg
 
Beiträge: 85
Registriert: Samstag 1. Oktober 2011, 18:00
Wohnort: Portugal

Re: What can you say about multithreading in THELI GUI?

Beitragvon mischa » Dienstag 23. Februar 2016, 19:41

Hi Oleg,

not all processes can be fully parallelised. Step 2 has a full CPU load because each CPU can resample data from the chip assigned to it independently from the other CPUs.
At step 3 all the resampled images are read and combined into the output image. I guess this is a more sequential progress. I remember Emmanuel Bertin mentioning that this part of Swarp is more difficult to multi-thread.

You can cook 10 chicken at the same time, but you can only eat them one after the other.

mischa
mischa
Moderator
 
Beiträge: 1266
Registriert: Freitag 7. Oktober 2011, 14:07
Wohnort: Chile

Re: What can you say about multithreading in THELI GUI?

Beitragvon oleg » Dienstag 23. Februar 2016, 20:14

Look at my another screenshot from "Astro+photometry":

This step uses only one thread (P.S. pardon: three threads) for Calculation astrometric solution.

Bild

Is it normally?
OR

Is it the problem with SCAMP compilation???
Zuletzt geändert von oleg am Dienstag 23. Februar 2016, 20:25, insgesamt 1-mal geändert.
Ubuntu 14.04 64-bit (CPU Intel® Core™ i7-3930K, RAM 64GB, RAID0: 6x1TB).
oleg
 
Beiträge: 85
Registriert: Samstag 1. Oktober 2011, 18:00
Wohnort: Portugal

Re: What can you say about multithreading in THELI GUI?

Beitragvon mischa » Dienstag 23. Februar 2016, 20:22

I see three CPUs at 100%. Not all parts of Scamp are fully parallelised. The initial matching with the WCS is fully multi-threaded, the calculation of the higher order distortions is only partially multi-threaded.

As I said before, not all algorithms can be done in parallel.
mischa
Moderator
 
Beiträge: 1266
Registriert: Freitag 7. Oktober 2011, 14:07
Wohnort: Chile

Re: What can you say about multithreading in THELI GUI?

Beitragvon oleg » Dienstag 23. Februar 2016, 20:26

mischa hat geschrieben:I see three CPUs at 100%. Not all parts of Scamp are fully parallelised. The initial matching with the WCS is fully multi-threaded, the calculation of the higher order distortions is only partially multi-threaded.

As I said before, not all algorithms can be done in parallel.

Ok. Many thanks!
Ubuntu 14.04 64-bit (CPU Intel® Core™ i7-3930K, RAM 64GB, RAID0: 6x1TB).
oleg
 
Beiträge: 85
Registriert: Samstag 1. Oktober 2011, 18:00
Wohnort: Portugal


Zurück zu Arbeiten mit Theli

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 18 Gäste

cron