Intel’s Confusing Messaging: Is Comet Lake Better Than Ice Lake?by Dr. Ian Cutress on January 16, 2020 9:00 AM EST
- Posted in
- Trade Shows
- Ice Lake
- Comet Lake
- CES 2020
This year at CES 2020, Intel held its usual pre-keynote workshop for select members of the press. Around 75 of us across a couple of sessions were there to hear Intel’s latest messaging and announcements from the show: a mixture of messaging and preview of the announcements to be made at the keynote. This isn’t unusual – it gives the company a chance to lay down a marker of where it thinks its strengths are, where it thinks the market is heading, and perhaps gives us a highlight into what might be coming from the product hardware perspective. The key messages on Intel’s agenda this year were Project Athena, accelerated workloads, and Tiger Lake.
We’ve covered Tiger Lake in a previous article, as it shapes up to be the successor to Ice Lake later in the year. Intel’s Project Athena is also a known quantity, being a set of specifications that Intel wants laptop device manufacturers to follow in order to create what it sees as the vision of the future of computing. The new element to the discussion is actually something I’ve been pushing for a while: accelerated computing. With Intel now putting AVX-512 in its consumer processors, along with a stronger GPU and things like the Gaussian Neural Accelerator, actually identifying what uses these accelerators is quite hard, as there is no official list. Intel took the time to give us a number of examples.
In this case, we’re seeing AI enhancements in the Adobe suite, Cyberlink, Blender, XSpit, and a few others. Eight of these are CPU/AVX-512 enhanced, six are GPU enhanced, and one is via the GNA. For a technology like AVX-512 to only have eight enhanced consumer applications several years after its first launch (Skylake-X was launched in May 2017) isn’t actually that great, but at least Intel is now telling us where we can find them, aside from specific compute benchmarks (3DMark Physics, y-cruncher).
As always with these presentations, part of the company’s aim is to showcase how they beat the competition. These are often cherry picked benchmarks that highlight the key points, however as it has been noted of late, Intel has been focused on ‘real world performance’ benchmarks, and is trying to shun what it calls ‘unrepresentative tests’, like CineBench, or synthetic tests. As part of this showcase, Intel was quick to point out that its laptop offerings provide more performance and better features than AMD’s Ryzen Mobile 3000 series.
It’s worth noting that when Intel or AMD show benchmark numbers, as a member of the press, it’s best to actually not pay too much attention here. Because these are often cherry picked numbers, first-party benchmarks by the companies aren’t the same as an independent test in a review. We take them with a pile of salt, but only if we bother to listen to them in the first place.
Now this is one slide that caused a lot of discussion after the event from social media, rather than the press. In this slide, Intel shows two comparable systems, the R7 3750H with an RTX 2060, against an i7-9750H with the same GPU at the same speed. Both CPUs are targeting the same market, and with the same discrete GPU, Intel puts itself ahead in the gaming tests.
Intel also added in the ‘best’ gaming system on the market today, at the maximum price, to this slide to offer a comparison point to show that there is currently no AMD system on the market with the ‘best’ graphics. This graph was meant to demonstrate that AMD can’t play in this high-end space, because OEMs won’t pair their CPUs with the best graphics. With these results, the press agreed that AMD doesn’t play in this space with Ryzen Mobile 3000, and the benchmark comparison was somewhat obsolete in that regard. The discussion on social media turned to whether Intel was being genuine in comparing AMD’s best with Intel’s best, despite the significant price difference in the CPU and comparing an RTX 2060 to an RTX 2080. To be honest, I agreed with Intel here – it wasn’t a graph designed to show like for like, but just how much performance is still on the table when money is no object. This graph became somewhat obsolete very quickly anyway, given that AMD announced its new Ryzen Mobile 4000 CPUs the next day.
However, this isn’t the slide I want to talk about today. There were a pair of slides that Intel showed that had me rather confused and surprised that I don’t think anyone else picked up on.
For the 15W processors, for thin and light laptops, Intel showed two sets of data. I’ll give the raw graphs here.
First was AMD’s Ryzen 7 3700U against Intel’s Comet Lake based Core i7-10710U:
The next was AMD’s Ryzen 7 3700U against Intel’s Ice Lake based Core i7-1065G7:
All three CPUs are the best 15 W CPUs that AMD and Intel has in the ultra-mobile market and notebooks at the time of writing.
Despite Intel’s push for ‘real world’ benchmarks, the tests start with PCMark10 (a synthetic to ‘emulate’ real world, mostly Microsoft Office) and WebXPRT 3 (a synthetic web test from Principled Technologies, a company known for producing paid-for Intel performance whitepapers). Then we have a series of direct Microsoft Office throughput metrics, and finally some Intel GPU enhanced AI tests provided by Topaz Labs.
The curious thing for me wasn’t so much the comparison between AMD and Intel. We know that Ryzen Mobile 3000 was still behind Intel's latest generation of processors in a lot of tasks, as evidenced by our Microsoft Surface Laptop 3 review, where we tested Intel 10th Gen vs AMD Ryzen Mobile 3000 in the same form factor. There's going to be more parity when we can test against the new Ryzen Mobile 4000 CPUs later this year.
The curious thing for me is that Intel had provided its own comparison data, for both Comet Lake and Ice Lake, but didn't do its own direct comparison between the two. Both of these CPUs fall under Intel’s ‘10th Gen Core’ branding, but Comet is on a 14++ manufacturing process, with 6 cores and Gen 9 graphics, while Ice is on a 10nm manufacturing process with 4 cores, higher IPC, and Gen 11 graphics. Both CPUs are set for 15 W, so you might expect both to be in similar designs, however Intel has positioned Ice Lake as its cost-premium processor due to its higher IPC, while Comet Lake is more for the bulk of the market. Comparing the two probably isn't in Intel's best interest.
We’ve tested Ice Lake, both in Intel’s Software Development System and in the Microsoft Surface Laptop 3, and it has a sizeable per-clock performance advantage over Intel’s 14++ hardware. The only downside is that it does not clock as high, meaning that Ice Lake and Comet Lake will be fighting for performance dominance, although it is expected for Ice Lake to win most of the tests: in Intel’s original Ice Lake disclosure, they cited a small jump over the previous generation 15 W processors.
Comet Lake isn't in this graph, however it's meant to be the successor to Whiskey Lake built on the same manufacturing process, except tweaked for more performance by virtue of the 10th Gen Core stature. It comes in 4-core and 6-core variants, with the latter being more than what Whiskey Lake offered.
As a given, Ice Lake wins in graphics against Comet Lake, by virtue of having 2x the execution units. That's not indispute here, however the CPU results are.
From Intel's data, I wanted to put Comet vs. Ice into one graph. With the data in one graph, we can see why Intel’s own slides did not put the data together: Ice Lake loses in most benchmarks against Comet Lake.
The first five benchmarks are PCMark 10, which Intel uses as a test to ‘represent real world benchmarks’, we have Comet Lake winning the first four, and then the browser test is essentially equal but in Ice Lake’s favor by less than 1%. With the WebXPRT test, another browser test, the result is again almost equal, but tips to Ice Lake. For the Microsoft Office real world tests, it’s split 50:50, with each CPU taking one each from Powerpoint and MSWord. The Photoshop test is a dead heat, and the cherry picked Topaz Labs AI tests aren’t particularly ‘real world’ in Intel’s defined sense since this is a niche software package and Intel has worked with the software vendor to enable GPU acceleration.
If we take out the GPU tests, for those keeping track, Comet Lake wins in a 6-4-1 result. If we considered anything below a 1% difference a tie, it's more like a 6-3-2.
|Intel's Data: Comet Lake vs Ice Lake|
Ryzen 7 3700U
|PowerPoint PDF Export||1.00x||1.83x||1.33x|
|Word Convert to PDF||1.00x||1.68x||1.63x|
|Word Mail Merge Error Check||1.00x||1.54x||1.79x|
|PowerPoint Export to 1080p Video||1.00x||1.44x||1.61x|
|PS Element CC Colorize Photo||1.00x||2.00x||2.00x|
Ryan and I spent some time discussing these results. Some of these tests rely heavily on turbo, such as the PCMark tests, and so the Comet Lake i7-10710U can hit 4.7 GHz on the latest variant of Skylake, while the Ice Lake i7-1065G7, despite its higher IPC difference, can only do 3.9 GHz. This means in a lot of bursty workloads (which a lot of business workloads are), the Comet Lake wins and we see that play out.
For the Microsoft Office workloads, it depends on if the workload is IPC sensitive of thread sensitive. Comet Lake here can spin up 12 threads at 3.9 GHz or higher, while Ice Lake can only do 8 threads at 3.5 GHz or higher. The PowerPoint PDF Export is a crushing win for Comet Lake, over 30%, whereas the Mail Merge Error Check and PowerPoint Export to 1080p Video is 10% in favor of Ice. What I want to know is, what presenters are exporting PowerPoint presentations to 1080p video? Is that seriously a common use case? I’d argue that exporting slides to PDF is >100x a more frequent workload here, which is why Comet Lake’s +30% performance gain over Ice is more important than Ice’s +10% win in exporting to a presentation to video. Not only that, but PCMark's own Office subtests put Comet ahead.
With all this in mind, what does it mean? Intel seems unwilling to put Comet Lake and Ice Lake in the same graph because Comet Lake has some serious hardcore wins in ‘real world benchmarks’, and it isn’t until Intel introduces the accelerated workloads, built upon Ice Lake’s GPU or AVX-512 unit, or games, or connectivity, where Ice Lake can get a true win. But those are specific scenarios for specific individuals, which does go against the ethos of Intel’s march on ‘real world performance’.
Ultimately Intel is in its own catch-22. It needs to show off the fact that it has processors with acceleratable elements that can smash the competition (and previous generations), but at the same time, because those features aren’t widespread, it’s trying to combine it with the ‘performance in the real world’ messaging and asking reviewers to target the more popular workloads, even if Intel isn’t doing that itself in its own performance comparisons. The easiest way for Intel to approach this is to remove this notion of ‘real-world performance’ being the ultimate goal, because with it the company is shooting itself in the foot. It can’t both push reviewers to focus on real world performance and yet highlight its accelerators for niche applications. Sure, going after real world performance is a laudable goal, but Intel has to understand that it needs to market its data appropriately. At the minute it’s coming up in a big jumbled mess that doesn’t do anyone any favors - least of all Intel.
Post Your CommentPlease log in or sign up to comment.
View All Comments
Smell This - Saturday, January 18, 2020 - link
I'm not the guy to do a "Deep Dive" on functional/structural cell issues, and generally agree with what you are saying, but my understanding is AMD made a concerted effort with the 'Cat Cores' and high density cell libraries at 28nm.
So much so, that AMD 28nm cell density was generally equivalent to Chipzillah's 14nm, especially given that Kaby went backward on fin/gate structures. The issues, as I see them, is a proper mix of short/tall cells and logic, and execution. AMD and TMSC (and Global Foundries) has got their groove on -- Intel these days, not so much.
Intel will get their groove back, but at what cost? Adding 'bolt-on' EUs is not the answer, otherwise they're spinning their wheels until Xe matures and the uncore, logic, etc., find the right mix.
lmcd - Saturday, January 18, 2020 - linkAMD 28nm density needed to be good because of how much space a Bulldozer core block took up. That's part of why people complained so much about Bulldozer -- it seemed like there was little reason a die-shrunk Thuban couldn't compete with Intel.
Smell This - Saturday, January 18, 2020 - linkPsssst
You did not respond to a thing I said, did you?
AMD evolved cell libraries significantly increasing density AND reducing power with their Carrizo APUs at 28nm (some at 'bulk' but I recall an ''LP' process, too).
And Dude ... your 'die-shrunk' talking point is old and busted.
Spunjji - Monday, January 20, 2020 - linkThat's pretty a-historical. Even assuming a meaningful clock boost could have been achieved from the die shrink (and this is a big if - Thuban didn't clock so well), it was still far behind Intel's competing architecture when it came to IPC.
Spunjji - Monday, January 20, 2020 - link"The process itself is not an issue."
It's not clear that this is true - they still haven't built anything larger than a 4 core chip on 10nm, and the most obvious reason for that would be to keep die size low so that yields remain high.
The existence of "10th generation" 14nm product lines bolsters this theory: they simple can't produce enough processors on 10nm to fulfil demand.
ikjadoon - Thursday, January 16, 2020 - linkWas it confirmed they were both using the same chassis w/ the same cooling design & same PL2 & Tau? Because on the outset, it seems the 4C/8T 10nm+ Ice Lake (i7-1065G7) would be more power efficient than a 6C/12T 14nm+++ Comet Lake (i7-10710U).
The slides say "See backup for configuration detail", which doesn't share much.
The easy rebuttal from Intel: the Ice Lake system ran cooler and drew less power, which they'll call a "user experience win" (as Intel's TDPs can sandbag, e.g., "65W" 4C/4T CPUs often drew far less).
ikjadoon - Thursday, January 16, 2020 - linkIf these tests use Intel's SDS, I'd point to Anandtech's previous reporting:
"Like other reference designs (such as Qualcomm’s), these [Intel SDS] units are designed to work, and are for the best part thermally unconstrained. The fan is on all the time, there are massive bezels, and the device itself is a bit chunky, to provide all the ports that the chip can provide."
In a thermally unconstrained system, the hex-core with massive boost is going to beat the quad-core at average boost—and I'd not be surprised.
But how many laptops today are anything close to "thermally unconstrained"? In an actual laptop design meant for 15W, how would they compare?
Santoval - Thursday, January 16, 2020 - linkThe 6-core Comet Lake does not necessarily have a higher TDP. If the chassis and cooling solution max out at a ~15W for continuous operation that's its limit (at base clock), with short or very short turbo bursts. Bear in mind that Intel calculates TDP only from the base clock. It takes no account of turbo clocks, which are either very short or a bit longer depending on how much time the cooling solution can thermally handle the TDP-up limit of 25W.
Comet Lake has 6 cores but a *much* lower turbo frequency (3.9 GHz instead of 4.7 GHz), so that its TDP-up while at the turbo frequency is also 25W, just like Ice Lake. It might sounds counter-intuitive but increasing cores while slashing base and turbo clocks is more power efficient than retaining the same number of cores while increasing both clocks. The trade-off of adding more cores is lower single core performance and larger dies (and thus lower yields and higher costs), not lower power efficiency - provided, of course, that clocks drop accordingly.
Fataliity - Thursday, January 16, 2020 - linkWhatt???
Ice Lake - 4c/8t, 3.9GHz boost
10710u - 6c/12t, 4.7GHz boost.
Ice Lake hits up to 50W in the surface review. Not 25W.
10710u probably also hits 50W in boost, until thermal constrains it to ~30Watt.
Fataliity - Thursday, January 16, 2020 - linkAlso, the tray price is almost identical. Around $420 per CPU.