NEW Benchmark comparison between AMD & Nvidia - 2.0

Discussion in 'General Discussion' started by DrR1pper, Sep 28, 2014.

  1. DurgeDriven

    DurgeDriven Banned

    Joined:
    Mar 20, 2012
    Messages:
    6,320
    Likes Received:
    43
    What is this preoccupation with benchtests ? it is not 3DMark ? :)



    Drive the thing ! ;)
     
  2. speed1

    speed1 Banned

    Joined:
    Jul 26, 2012
    Messages:
    1,858
    Likes Received:
    0
    That's true. The other possibility would be to start with everything low/off and than to run with high/max/on whatever is possible but both tests without AF and AA in use.

    Let me come back to this after doing the solo bench. ;)
     
  3. DrR1pper

    DrR1pper Registered

    Joined:
    Apr 29, 2012
    Messages:
    3,294
    Likes Received:
    36
    Ok, but is a default player.json really necessary?

    Good idea on the default Nvidia/AMD control panel 3D settings. Can you take a picture of that for me please and i'll do the same for Nvidia.
     
  4. speed1

    speed1 Banned

    Joined:
    Jul 26, 2012
    Messages:
    1,858
    Likes Received:
    0
    Solo lap benchmark on LochD./Civic - practice settings standard as it comes with the tracks first install - all other settings as the replay benchmark, except from AA is set to 4XMSAA in the CCC :

    CPU @ 4000Mhz - GPU standard:

    1. - Frames, Time (ms), Min, Max, Avg
    10603, 84365, 107, 153, 125.680

    2. - Frames, Time (ms), Min, Max, Avg
    10554, 84646, 107, 152, 124.684

    CPU @ 4000Mhz - GPU OC 10%:

    1. - Frames, Time (ms), Min, Max, Avg
    11391, 84256, 114, 164, 135.195

    2. - Frames, Time (ms), Min, Max, Avg
    11407, 84458, 117, 163, 135.061
     
  5. Marek Lesniak

    Marek Lesniak Car Team Staff Member

    Joined:
    Oct 6, 2010
    Messages:
    1,585
    Likes Received:
    101
    But I DO use GPU-Z during tests to check if things are as expected. That's why I suggested to others, to use it as well.
     
  6. DrR1pper

    DrR1pper Registered

    Joined:
    Apr 29, 2012
    Messages:
    3,294
    Likes Received:
    36
    Ok good. This is very interesting and telling.

    So it would appear that for you, overclocking your GPU in the replay benchmarks didn't yield any difference (for whatever unknown reason) and in this live benchmark it seems to be working correctly.

    Btw, i don't know if you made a mistake with stating (in the other thread) that you overclocked your CPU and not your GPU in the Firestrike benchmark but your performance increased 8% in rf2 with your 10% GPU overclock, identically to your 8% increase in Firestrike GPU performance.
     
  7. Marek Lesniak

    Marek Lesniak Car Team Staff Member

    Joined:
    Oct 6, 2010
    Messages:
    1,585
    Likes Received:
    101
    Just finished doing several runs. 9 runs in a row (everytime exiting to main menu of course) then restared rF 2 and did 2 more runs.
    Different performance, because I switched back to my 22" 1680x1050 monitor.

    Code:
    Frames, Time (ms), Min, Max, Avg
     14270,    199996,  56,  94, 71.351
    
    Frames, Time (ms), Min, Max, Avg
     14233,    199953,  56,  94, 71.182
    
    Frames, Time (ms), Min, Max, Avg
     14298,    200086,  57,  94, 71.459
    
    Frames, Time (ms), Min, Max, Avg
     14235,    199931,  56,  94, 71.200
    
    Frames, Time (ms), Min, Max, Avg
     14226,    199894,  56,  93, 71.168
    
    Frames, Time (ms), Min, Max, Avg
     14238,    199910,  56,  93, 71.222
    
    Frames, Time (ms), Min, Max, Avg
     14213,    200090,  56,  93, 71.033
    
    Frames, Time (ms), Min, Max, Avg
     14226,    200008,  56,  94, 71.127
    
    Frames, Time (ms), Min, Max, Avg
     14206,    199985,  56,  94, 71.035
    
    -------------------------------------
    
    Frames, Time (ms), Min, Max, Avg
     14309,    200005,  56,  94, 71.543
    
    Frames, Time (ms), Min, Max, Avg
     14264,    199979,  56,  94, 71.327
    
    Do you see any significant inconsistency here? Because I don't. That's why we ended up using that particular benchark, right?
    On the other hand, are you that sure, doing a single lap solo will give you 100% consistent scores? Have you checked that? ;)
     
  8. speed1

    speed1 Banned

    Joined:
    Jul 26, 2012
    Messages:
    1,858
    Likes Received:
    0
    DrR1pper, in relation to the firestrike bench, It should be no problem to test it again but that was the case yes, one test without GPU OC and one with 10% GPU OC but both tests where performed with the CPU @4000Mhz instead to 3800Mhz previously.

    And yes i see the solo benchmark result is better with 10% GPU OC but it didn't does anything to the replay benchmark.
     
  9. DrR1pper

    DrR1pper Registered

    Joined:
    Apr 29, 2012
    Messages:
    3,294
    Likes Received:
    36
    Those from you are pretty consistent but know that the inconsistency only arises when you quit out of the replay and reload it again. So technically there was only 1 chance of an inconsistency coming up in your 9 repeated runs and it was when you restarted rf2 (between runs 7 and 8).

    The fact that Timpsie got an inconsistency though and how problematic the replay method has been shown over the last few days, i think it's just safer to use the solo live benchmark (and for sanity sake! :p)

    Yes i have and it is superbly consistent. The lowest consistency i've found so far is 99.94%. It's pretty darn consistent. :)
     
  10. DrR1pper

    DrR1pper Registered

    Joined:
    Apr 29, 2012
    Messages:
    3,294
    Likes Received:
    36
    Right, well without saying any of this it became all very confusing due to the scattered nature of the posts (and it still is).

    If you want to show me you're cpu is affecting your gpu score, all you have to do is perform 2 firestrikes tests, both with constant gpu clocks and alternate the cpu speed. If no change....no cpu bottleneck.
     
  11. Marek Lesniak

    Marek Lesniak Car Team Staff Member

    Joined:
    Oct 6, 2010
    Messages:
    1,585
    Likes Received:
    101
    As I stated already, I go back to the main menu and reload the reply before every run (means, the reply file has been loaded 11 times).

    Solo live bench on a single full hd screen, for top gfx cards gives you quite high fps = CPU will have more influence on final score. For benchmarks we are looking for, it is safer to stay with lower fps, to exclude CPU influence as much as possible. But of course, for sanity check (as an additional benchmark), it's perfectly fine.
     
  12. DrR1pper

    DrR1pper Registered

    Joined:
    Apr 29, 2012
    Messages:
    3,294
    Likes Received:
    36
    Oh, i didn't see where you said that but ok.
     
  13. Marek Lesniak

    Marek Lesniak Car Team Staff Member

    Joined:
    Oct 6, 2010
    Messages:
    1,585
    Likes Received:
    101
    Here :)

     
  14. DrR1pper

    DrR1pper Registered

    Joined:
    Apr 29, 2012
    Messages:
    3,294
    Likes Received:
    36
    Ah ok, my mistake. Sorry

    Perhaps some people don't experience the problem whilst others do. The fact Timpsie did is enough cause for concern i think.

    I'm running through all the solo live benchmarks now and will post results and testing method (etc) soon.

    At least this way you'll also have the real performances of the cards to compare with instead of the consistently much lower performances from the replays.
     
  15. Timpie Claessens

    Timpie Claessens Registered

    Joined:
    Jul 26, 2011
    Messages:
    491
    Likes Received:
    1
    I just tried to do another run just to see what results I got and again I got the 97fps avg one instead of 84fps. I'm not sure what the cause is but it certainly fluctuates in some cases. I didn't completely exit out of RF2 between benchmarks but did go back to the main menu and reloaded the replay.
     
  16. DrR1pper

    DrR1pper Registered

    Joined:
    Apr 29, 2012
    Messages:
    3,294
    Likes Received:
    36
    Yeah....we're going to have to ditch the replay benchmarks. Thanks for mentioning the problem happens so easily for you.
     
  17. Marek Lesniak

    Marek Lesniak Car Team Staff Member

    Joined:
    Oct 6, 2010
    Messages:
    1,585
    Likes Received:
    101
    Visible picture quality is always exactly the same? Have you noticed anything weird, when that "faster" pass goes along?
    Are you sure you have nothing running in the background and nV drivers are set to default?
     
  18. Timpie Claessens

    Timpie Claessens Registered

    Joined:
    Jul 26, 2011
    Messages:
    491
    Likes Received:
    1
    Nope I don't see any difference apart from the fact that the benchmarks starts at 95fps instead of 82fps when waiting on the grid :p
    And the faster runs happen randomly but have exactly the same results so I don't see how a background program or a driver setting could influence it in exactly the same way each time I get a faster benchmark.
    Obviously there's some stuff running in the background (avast in gamemode, Steam, dropbox, couple more) and Nvidia settings are application controlled.
     
  19. Spinelli

    Spinelli Banned

    Joined:
    Jan 28, 2012
    Messages:
    5,290
    Likes Received:
    32
    I was saying that I originally thought it would have been a good idea to do all that, but then I saw your message about making it quick and easy for everyone and realised you had a good point so ya, it may be too much for everyone.

    How about we just tell everyone to click default in their NVidia/AMD global (or rF2 game specific) profile. Then from there just set AA to override application and to 4xMSAA (don't forget to click apply! lol). You think that would be easier and more consistent? Pre-rendered frames will also then be set to default (probably 2 or 3) instead of 1 for any users who have changed it, but must people who change it are NVidia users anyway and not so many AMD users (it seems way more rF2-NVidia people know about/use NVidia Inspector compared to the amount of rF2-AMD users who know about/use Radeon Pro).

    So to summarize, "default", then 4xMSAA for everyone (and make sure rF2 AA is obviously set to "none")??...
     
    Last edited by a moderator: Sep 28, 2014
  20. DrR1pper

    DrR1pper Registered

    Joined:
    Apr 29, 2012
    Messages:
    3,294
    Likes Received:
    36
    When it happened to me it was very noticeable. It's not smooth at -16% performance and in the 2 times it jumped up 35%, not only was the fps showing it so but it was visually extremely silky smooth. The fps averages were 49 fps (-16%), 58 fps (expected) and 79 fps (+35%). Since it was around the 60 fps mark, was quite visually noticeable seeing the difference.

    The two times +35 occured i had walked out of the room. However i check the benchmark excel spreadsheets first and when i saw it say avg 79 instead of avg 49, i went back in to watch the replay and sure enough it was running at a much higher framerate consistently throughout. Only when i quit out the reply and rejoined did it then suddenly (and depressingly) defer back to the avg 49 fps. So very strange.
     
    Last edited by a moderator: Sep 28, 2014

Share This Page