Author Topic: Extremely poor core utilization only 15% of my cores T4.0  (Read 351 times)

Offline Themodman101

  • Member
  • *
  • Posts: 135
Extremely poor core utilization only 15% of my cores T4.0
« on: August 06, 2017, 05:19:03 AM »
See attached image for the results im getting in my render tests. Only 15% CPU utilization.
The Terragen Version = 4.0

My Machine Specs:

E2695V3 Xeon CPU X2  (14 cores 28 threads each CPU) both together makes 56 Threads.
32GB of DDR4 2133mhz ECC memory
980GTX
Windows 7 Pro (Fresh Install)

My settings are as follows:

micropoly detail = 0.5
AA = 4
Defer Atmo/Cloud = ON
Min threads = 1
Max threads = 64
Max Bucket Size = 256x256 with Autosize turned on
Sub-Div Cache size = 9000MB

The camera is facing the sun, with easy cloud Cumulus cloud layer at Quality 1.

I built two of these machines for the purpose of rapid rendering of CG, I was wondering if I have something setup wrong. The usage peaks around 19% sometimes. Even the cores that are being used arent being used effectively. I read in a number of threads on here (Albeit very old ones) that turning off hyperthreading can help. But it doesn't appear to in my case.

Thanks in advance for any advice!


UPDATE:

after updating to 4.1 its improved some, so it appears that its the clouds! I get 100% pegged in task manager without the clouds. So is that all this is? Or is there more to the story?
« Last Edit: August 06, 2017, 08:46:43 AM by Themodman101 »

Offline jaf

  • Member
  • *
  • Posts: 640
Re: Extremely poor core utilization only 15% of my cores T4.0
« Reply #1 on: August 06, 2017, 05:33:37 PM »
My system seems to use the cores/threads as expected.  I did a quick easy cloud render test (tg4.1.11) with number of cores set to 8 and threads to 12 and I get a 76% cpu load (12/16). Then cores to 16 and threads 64 and I get 100% load.
(6/14/17) Ryzen 1800x, 960 EVO 500GB NVME-M.2 SSD, Corsair Vengeance 64GB DDR4 3200 Mem,  EVGA GeForce GTX 1080 Ti FTW3 Graphics, Win 10 Pro x64, Terragen 4.1.11

Offline Oshyan

  • Planetside Staff
  • *
  • Posts: 11676
  • Holy snagging ducks!
Re: Extremely poor core utilization only 15% of my cores T4.0
« Reply #2 on: August 06, 2017, 10:57:56 PM »
Very strange. Could you post the .tgd you're testing with?

Do you happen to have a Quadro card in there alongside the 980GTX, or perhaps using the Quadro drivers somehow?

- Oshyan

Offline Themodman101

  • Member
  • *
  • Posts: 135
Re: Extremely poor core utilization only 15% of my cores T4.0
« Reply #3 on: August 07, 2017, 03:17:21 AM »
Yeah see the attached file. And to answer you Quadro question, no I dont have a Quadro or Quadro drivers.

So I reinstalled 4.1 , loaded the terragen file, saved out a new version then re-rendered that new version. And it appears to be pegged at 100% now. Wonder if maybe something was wrong with my installation.

I attached the new performance image(With HyperThreading turned off)

So Ive seen a ton of different oppinions on the forums with regards to having HT on or off. With my machines specifically do you think I should leave it off since I have so many threads? Oshyan I believe I read 3 years ago you recommended leaving it off for anything higher than 16 cores. Is that still the case?
« Last Edit: August 07, 2017, 03:44:50 AM by Themodman101 »

Offline Themodman101

  • Member
  • *
  • Posts: 135
Re: Extremely poor core utilization only 15% of my cores T4.0
« Reply #4 on: August 07, 2017, 04:51:28 AM »
Now I have a new issue where Terragen 4.1.11 appears to be crashing my display driver when it completes rendering.it doesn't crash when i dont have the clouds in the scene. Albeit this is a very simple untouched scene other than the clouds, so I am testing other scenes right now.

That, is a new one for me haha. See attached my Dxdiag in case that information is useful.

UPDATE:

Hey so every other scene appears to render just fine, its just that one scene. That I attached in my previous post. I received it from a buddy of mine who wanted to compare his render speed to mine. :P

So all appears well right now, let me know though if that file helps at all?
« Last Edit: August 07, 2017, 06:37:15 AM by Themodman101 »

Offline KlausK

  • Member
  • *
  • Posts: 282
  • Land ho!
Re: Extremely poor core utilization only 15% of my cores T4.0
« Reply #5 on: August 07, 2017, 08:35:37 AM »
I rendererd your file 3 times after restarting my pc everytime in between.
No crashes. Renders fine with high cpu utilization. Took about 54 minutes on average (see specs in footnote).
NVidia driver is 384.94_desktop_win8_win7_x64_int_whql for my GTX 780.
Cheers, Klaus
/ ASUS WS Mainboard / Dual XEON E5-2640v3 / 64GB RAM / NVIDIA GeForce GTX 780 / Win7 Ultimate

Offline Oshyan

  • Planetside Staff
  • *
  • Posts: 11676
  • Holy snagging ducks!
Re: Extremely poor core utilization only 15% of my cores T4.0
« Reply #6 on: August 07, 2017, 10:17:42 PM »
I'm glad you seem to have mostly got things resolved, especially regarding CPU usage. We no longer recommended disabling hyperthreading as subsequent improves to the render engine have made multithreading more efficient overall. You can still have decent gains upwards of 32 threads at this point (though with diminishing returns, which is true of most render engines).

We will test the file on our end to see if it crashes, but do make sure you have the latest graphics driver update as well. Klaus, thanks for testing too, that's helpful. :)

- Oshyan

Offline Themodman101

  • Member
  • *
  • Posts: 135
Re: Extremely poor core utilization only 15% of my cores T4.0
« Reply #7 on: August 08, 2017, 03:24:30 AM »
Okay thanks Oshyan, and KlausK. Im still getting display driver crashes randomly when rendering through my many tests. But I doubt it has anything to do with Terragen. This machine is brand new and I probably need to make some adjustments to the setup.

I have updated to latest GPU driver for the 980, still crashes once in a while. I may need to modify my RAM slot to put it in the PCIE slot for CPU1. we'll see if that makes a difference. I will also re-enable hyperthreading as well.


Offline Oshyan

  • Planetside Staff
  • *
  • Posts: 11676
  • Holy snagging ducks!
Re: Extremely poor core utilization only 15% of my cores T4.0
« Reply #8 on: August 08, 2017, 09:52:13 PM »
Sounds good. Let us know if you are able to find the source of the crashes. Terragen does not make heavy use of the GPU, but the regular 3D Preview (not RTP) and parts of the UI use basic OpenGL functions. These should never cause crashes but do occasionally for certain people. Usually the driver version is the cause. Using the latest sometimes fixes it but not always.

- Oshyan

 

anything