Yes that seems very high. Recipe and method can really impact the amount of fat and calories in a cake.
Technique can be a gauge to guide you toward cakes with lower fat and calories.
A butter cake uses the creaming method. This requires substantially more butter, sugar, milk, and eggs.
By contrast, foam cakes are leavened by whipped egg whites or ribboned whole eggs. They use less flour and sugar. Butter is used in very small quantities.
In many foam cake recipes, oil replaces butter. This difference can substantially reduces the amount of saturated fat in the cake when the appropriate oil is used.
Where a tablespoon of butter contains 7 grams of saturated fat, an oil like safflower oil contains 1 gram of saturated fat.
Never use coconut oil as it is nearly 90% saturated fat. A single tablespoon of coconut oil contains 12 grams of saturated fat.
Foam cakes require significantly less liquid as well. So little or no milk is used. Often, juice or other liquids can replace milk.
Foam cakes are sponge cakes, chiffon cakes, and genoise.
Since we Asians prefer a less sweet cake, many sponge, chiffon, and genoise have a per serving calorie count similar to a candy bar.
The Japanese also make a cake called castella. It’s a sponge cake introduced to Japan by Europeans. But over the years Japanese have made this cake their own.
Evaporated milk has a significantly higher amount of fat and calories compared to fresh milk. Where evaporated milk is 7% – 10% fat, depending on brand, whole fresh milk is 3.25% fat.
1/2 cup of evaporated milk contains about 170 calories.
1/2 cup whole milk contains about 75 calories.
Evaporated milk was invented to extend shelf life. But given the high fat and calories, it came in to popular use during WWII. For soldiers on the battlefield, evaporated milk provided much needed energy in the form of high calories and fat in a compact can. Off the battlefield, whole milk was rationed, so not available for baking. Bakers quickly discovered evaporated milk made a good substitution for fresh milk. So many recipes with evaporated milk originated from the war years.
Reducing caloric and fat in icings are more challenging as the primary ingredients are fat and sugar. Use of low fat cream cheese, sugar substitutes, replacing some or all the butter with non-dairy alternatives helps.
A link for a Japanese sponge cake recipe and video.
https://www.japanesecooking101.com/sponge-cake-recipe/