C++ performance vs. Java/C#

JIT vs. Static Compiler

As already said in the previous posts, JIT can compile IL/bytecode into native code at runtime. The cost of that was mentionned, but not to its conclusion:

JIT has one massive problem is that it can’t compile everything: JIT compiling takes time, so the JIT will compile only some parts of the code, whereas a static compiler will produce a full native binary: For some kind of programs, the static compiler will simply easily outperform the JIT.

Of course, C# (or Java, or VB) is usually faster to produce viable and robust solution than is C++ (if only because C++ has complex semantics, and C++ standard library, while interesting and powerful, is quite poor when compared with the full scope of the standard library from .NET or Java), so usually, the difference between C++ and .NET or Java JIT won’t be visible to most users, and for those binaries that are critical, well, you can still call C++ processing from C# or Java (even if this kind of native calls can be quite costly in themselves)…

C++ metaprograming

Note that usually, you are comparing C++ runtime code with its equivalent in C# or Java. But C++ has one feature that can outperform Java/C# out of the box, that is template metaprograming: The code processing will be done at compilation time (thus, increasing vastly compilation time), resulting into zero (or almost zero) runtime.

I have yet so see a real life effect on this (I played only with concepts, but by then, the difference was seconds of execution for JIT, and zero for C++), but this is worth mentioning, alongside the fact template metaprograming is not trivial…

Edit 2011-06-10: In C++, playing with types is done at compile time, meaning producing generic code which calls non-generic code (e.g. a generic parser from string to type T, calling standard library API for types T it recognizes, and making the parser easily extensible by its user) is very easy and very efficient, whereas the equivalent in Java or C# is painful at best to write, and will always be slower and resolved at runtime even when the types are known at compile time, meaning your only hope is for the JIT to inline the whole thing.

…

Edit 2011-09-20: The team behind Blitz++ (Homepage, Wikipedia) went that way, and apparently, their goal is to reach FORTRAN’s performance on scientific calculations by moving as much as possible from runtime execution to compilation time, via C++ template metaprogramming. So the “I have yet so see a real life effect on this” part I wrote above apparently does exist in real life.

Native C++ Memory Usage

C++ has a memory usage different from Java/C#, and thus, has different advantages/flaws.

No matter the JIT optimization, nothing will go has fast as direct pointer access to memory (let’s ignore for a moment processor caches, etc.). So, if you have contiguous data in memory, accessing it through C++ pointers (i.e. C pointers… Let’s give Caesar its due) will goes times faster than in Java/C#. And C++ has RAII, which makes a lot of processing a lot easier than in C# or even in Java. C++ does not need using to scope the existence of its objects. And C++ does not have a finally clause. This is not an error.

🙂

And despite C# primitive-like structs, C++ “on the stack” objects will cost nothing at allocation and destruction, and will need no GC to work in an independent thread to do the cleaning.

As for memory fragmentation, memory allocators in 2008 are not the old memory allocators from 1980 that are usually compared with a GC: C++ allocation can’t be moved in memory, true, but then, like on a Linux filesystem: Who needs hard disk defragmenting when fragmentation does not happen? Using the right allocator for the right task should be part of the C++ developer toolkit. Now, writing allocators is not easy, and then, most of us have better things to do, and for the most of use, RAII or GC is more than good enough.

Edit 2011-10-04: For examples about efficient allocators: On Windows platforms, since Vista, the Low Fragmentation Heap is enabled by default. For previous versions, the LFH can be activated by calling the WinAPI function HeapSetInformation). On other OSes, alternative allocators are provided (see https://secure.wikimedia.org/wikipedia/en/wiki/Malloc for a list)

Now, the memory model is somewhat becoming more complicated with the rise of multicore and multithreading technology. In this field, I guess .NET has the advantage, and Java, I was told, held the upper ground. It’s easy for some “on the bare metal” hacker to praise his “near the machine” code. But now, it is quite more difficult to produce better assembly by hand than letting the compiler to its job. For C++, the compiler became usually better than the hacker since a decade. For C# and Java, this is even easier.

Still, the new standard C++0x will impose a simple memory model to C++ compilers, which will standardize (and thus simplify) effective multiprocessing/parallel/threading code in C++, and make optimizations easier and safer for compilers. But then, we’ll see in some couple of years if its promises are held true.

C++/CLI vs. C#/VB.NET

Note: In this section, I am talking about C++/CLI, that is, the C++ hosted by .NET, not the native C++.

Last week, I had a training on .NET optimization, and discovered that the static compiler is very important anyway. As important than JIT.

The very same code compiled in C++/CLI (or its ancestor, Managed C++) could be times faster than the same code produced in C# (or VB.NET, whose compiler produces the same IL than C#).

Because the C++ static compiler was a lot better to produce already optimized code than C#’s.

For example, function inlining in .NET is limited to functions whose bytecode is less or equal than 32 bytes in length. So, some code in C# will produce a 40 bytes accessor, which won’t be ever inlined by the JIT. The same code in C++/CLI will produce a 20 bytes accessor, which will be inlined by the JIT.

Another example is temporary variables, that are simply compiled away by the C++ compiler while still being mentioned in the IL produced by the C# compiler. C++ static compilation optimization will result in less code, thus authorizes a more aggressive JIT optimization, again.

The reason for this was speculated to be the fact C++/CLI compiler profited from the vast optimization techniques from C++ native compiler.

Conclusion

I love C++.

But as far as I see it, C# or Java are all in all a better bet. Not because they are faster than C++, but because when you add up their qualities, they end up being more productive, needing less training, and having more complete standard libraries than C++. And as for most of programs, their speed differences (in one way or another) will be negligible…

Edit (2011-06-06)

My experience on C#/.NET

I have now 5 months of almost exclusive professional C# coding (which adds up to my CV already full of C++ and Java, and a touch of C++/CLI).

I played with WinForms (Ahem…) and WCF (cool!), and WPF (Cool!!!! Both through XAML and raw C#. WPF is so easy I believe Swing just cannot compare to it), and C# 4.0.

The conclusion is that while it’s easier/faster to produce a code that works in C#/Java than in C++, it’s a lot harder to produce a strong, safe and robust code in C# (and even harder in Java) than in C++. Reasons abound, but it can be summarized by:

  1. Generics are not as powerful as templates (try to write an efficient generic Parse method (from string to T), or an efficient equivalent of boost::lexical_cast in C# to understand the problem)
  2. RAII remains unmatched (GC still can leak (yes, I had to handle that problem) and will only handle memory. Even C#’s using is not as easy and powerful because writing a correct Dispose implementations is difficult)
  3. C# readonly and Java final are nowhere as useful as C++’s const (There’s no way you can expose readonly complex data (a Tree of Nodes, for example) in C# without tremendous work, while it’s a built-in feature of C++. Immutable data is an interesting solution, but not everything can be made immutable, so it’s not even enough, by far).

So, C# remains an pleasant language as long as you want something that works, but a frustrating language the moment you want something that always and safely works.

Java is even more frustrating, as it has the same problems than C#, and more: Lacking the equivalent of C#’s using keyword, a very skilled colleague of mine spent too much time making sure its resources where correctly freed, whereas the equivalent in C++ would have been easy (using destructors and smart pointers).

So I guess C#/Java’s productivity gain is visible for most code… until the day you need the code to be as perfect as possible. That day, you’ll know pain. (you won’t believe what’s asked from our server and GUI apps…).

About Server-side Java and C++

I kept contact with the server teams (I worked 2 years among them, before getting back to the GUI team), at the other side of the building, and I learned something interesting.

Last years, the trend was to have the Java server apps be destined to replace the old C++ server apps, as Java has a lot of frameworks/tools, and is easy to maintain, deploy, etc. etc..

…Until the problem of low-latency reared its ugly head the last months. Then, the Java server apps, no matter the optimization attempted by our skilled Java team, simply and cleanly lost the race against the old, not really optimized C++ server.

Currently, the decision is to keep the Java servers for common use where performance while still important, is not concerned by the low-latency target, and aggressively optimize the already faster C++ server applications for low-latency and ultra-low-latency needs.

Conclusion

Nothing is as simple as expected.

Java, and even more C#, are cool languages, with extensive standard libraries and frameworks, where you can code fast, and have result very soon.

But when you need raw power, powerful and systematic optimizations, strong compiler support, powerful language features and absolute safety, Java and C# make it difficult to win the last missing but critical percents of quality you need to remain above the competition.

It’s as if you needed less time and less experienced developers in C#/Java than in C++ to produce average quality code, but in the other hand, the moment you needed excellent to perfect quality code, it was suddenly easier and faster to get the results right in C++.

Of course, this is my own perception, perhaps limited to our specific needs.

But still, it is what happens today, both in the GUI teams and the server-side teams.

Of course, I’ll update this post if something new happens.

Edit (2011-06-22)

“We find that in regards to performance, C++ wins out by a large margin. However, it also required the most extensive tuning efforts, many of which were done at a level of sophistication that would not be available to the average programmer.

[…] The Java version was probably the simplest to implement, but the hardest to analyze for performance. Specifically the effects around garbage collection were complicated and very hard to tune.”

Sources:

Edit (2011-09-20)

“The going word at Facebook is that ‘reasonably written C++ code just runs fast,‘ which underscores the enormous effort spent at optimizing PHP and Java code. Paradoxically, C++ code is more difficult to write than in other languages, but efficient code is a lot easier [to write in C++ than in other languages].“

– Herb Sutter at //build/, quoting Andrei Alexandrescu

Sources:

Related Posts:

  1. What is C# equivalent of in C++?
  2. Algorithms in O(n^2) vs O(n) [duplicate]
  3. C# Java HashMap equivalent
  4. C# Java HashMap equivalent
  5. ‘do…while’ vs. ‘while’
  6. Visual Studio /**/ comment shortcut?
  7. C# equivalent of C++ vector, with contiguous memory?
  8. how to convert C# to C++
  9. How to round up the result of integer division?
  10. Is dependency injection useful in C++
  11. Is dependency injection useful in C++
  12. Where to place native DLL to use Pocket PC emulator?
  13. Best way to reverse a string
  14. Fastest way to remove first char in a String
  15. Make first letter of a string upper case (with maximum performance)
  16. Is there an equivalent to the Scanner class in C# for strings?
  17. Critical error detected c0000374 – C++ dll returns pointer off allocated memory to C#
  18. C# equivalent to Java’s charAt()?
  19. Fastest way to generate a random boolean
  20. How can we prepend strings with StringBuilder?
  21. How to create a new object instance from a Type
  22. How do I generate a random int number?
  23. An existing connection was forcibly closed by the remote host
  24. Unexplained crashes related to ntdll.dll
  25. I am getting Failed to load resource: net::ERR_BLOCKED_BY_CLIENT with Google chrome
  26. What is parsing?
  27. How to fix “HTTP Error 400. The size of the request headers is too long” error from azure cloud services?
  28. What’s the C++ version of Java’s ArrayList
  29. Could not load file or assembly or one of its dependencies
  30. Adding values to a C# array
  31. LINQ’s Distinct() on a particular property
  32. Priority queue in .Net
  33. What is the difference between int, Int16, Int32 and Int64?
  34. Adding values to a C# array
  35. How can I add ” character to a multi line string declaration in C#?
  36. Input string was not in a correct format
  37. The request was aborted: Could not create SSL/TLS secure channel
  38. Unable to connect to web server ‘IIS Express’
  39. Twilio TwilioRestClient does not contain a definition for SendSmsMessage
  40. How to convert byte array to string
  41. ASP.NET Core Dependency Injection error: Unable to resolve service for type while attempting to activate
  42. System.web.mvc missing
  43. Nullable object must have a value?
  44. Sequence contains no elements?
  45. Best way to generate a random float in C#
  46. Check if list is empty in C#
  47. What is clr.dll on .Net framework and what does it do?
  48. How can I secure passwords stored inside web.config?
  49. Visual Studio says “Method must have a return type”
  50. How to Use TextureBrush for painting an Image
  51. C# compiler error: “not all code paths return a value”
  52. How do I read and parse an XML file in C#?
  53. How to fix “namespace x already contains a definition for x” error? Happened after converting to VS2010
  54. How do I create a Shared Code project (.shproj)
  55. OnCollisionEnter2D not being executed?
  56. The calling thread cannot access this object because a different thread owns it
  57. Convert JSON String To C# Object
  58. How can I fix Visual Studio 2015 exception Microsoft.vshup.server.httphostx64.exe has stopped working when run project
  59. IEnumerable vs List – What to Use? How do they work?
  60. How to convert code from C# to PHP
  61. Index was out of range. Must be non-negative and less than the size of the collection parameter name:index
  62. System.BadImageFormatException: Could not load file or assembly
  63. Could not load file or assembly ‘Microsoft.Web.Infrastructure,
  64. What is the purpose of the vshost.exe file?
  65. System.ComponentModel.Win32Exception: Access is denied Error
  66. Excel “External table is not in the expected format.”
  67. MSSQL Error ‘The underlying provider failed on Open’
  68. An object reference is required to access a non-static member
  69. Task vs Thread differences
  70. How to write a comment in a Razor view?
  71. Finalize vs Dispose
  72. How to download a file from a URL in C#?
  73. Calculate a MD5 hash from a string
  74. The model item passed into the dictionary is of type .. but this dictionary requires a model item of type
  75. How can I get the active screen dimensions?
  76. WebException (Status: Protocol Error)
  77. How to add a new row to datagridview programmatically
  78. Unexpected character encountered while parsing value
  79. Embedded statement cannot be a declaration or labeled statement
  80. MailMessage.To.Add() throwing exception : “An invalid character was found in the mail header: ‘,’.”
  81. Remove duplicates from a List in C#
  82. System.out.println function syntax in C++
  83. C# conditional operator error Only assignment, call, increment, decrement, await, and new object expressions can be used as a statement
  84. Cannot drop database because it is currently in use
  85. Troubleshooting “program does not contain a static ‘Main’ method” when it clearly does…?
  86. Unity 5.2.2 changing Visual Studio back to MonoDevelop
  87. Using FolderBrowserDialog in WPF application
  88. How to make Check Box List in ASP.Net MVC
  89. Is there an equivalent to the C# “var” keyword in C++/CLI?
  90. Playing a MP3 file in a WinForm application
  91. The server tag is not well formed error
  92. How to solve Operator ‘!=’ cannot be applied to operands of type ‘T’ and ‘T’
  93. Best way to randomize an array with .NET
  94. Encrypt and decrypt a string in C#?
  95. Key Value Pair List
  96. Using .Select and .Where in a single LINQ statement
  97. How to resize an Image C#
  98. Unrecognized escape sequence for path string containing backslashes
  99. C# Dictionary get item by index
  100. A field initializer cannot reference the nonstatic field, method, or property

Leave a Comment

error code: 523