The type and chemistry of batteries used in space are not the same as those used for terrestrial energy storage. The space batteries are not batteries of high capacity and many of them aren't chemical primary batteries at all. Some space "batteries" are actually RTGs, radioactive thermal generators which use plutonium nuclear decay to extract energy. Energy storage batteries on Earth would require heating to maintain their electrochemical properties and cannot be directly compared to space batteries.

Space batteries aren't meant to deliver huge amounts of power. They only output a few Watt-hours at best where terrestrial storage batteries for use in the power grid must be capable of delivering Killowatt-hours. Apples and kangaroos here. Also, space batteries need to be heated as well so they can function. They're not frozen and they will fail too if they get too cold. Space batteries also don't have to deal with water condensation since there is no humidity in space.

We use batteries in space because vacuum doesn't absorb heat like atmosphere.

I live in a place where it gets cold, -40 and colder kind of cold. We have plugs on our cars for block heaters. Basically, if you don't plug in your car in very cold weather, and the battery gets too cold, you aren't going to get a spark to start your engine, you will need a boost and probably have to hook up a battery charger along with the block heater to get a full charge back in your battery.

Space is not extreme weather. First off, I doubt anything like that is exposed to raw vacuum. Just saying, and if it was, it would be sealed. Then too, do you know why thermos bottles work? Because heat can't transfer as fast through a vacuum. Space vacuum tends to insulate. Heat buildup is more a problem than extreme cold.