There are different types of lithium batteries (6 or 7 anyway). LiFePO4 (Lithium Iron Phosphate) is not what you have in your cell phone or your Tesla, or your ebike. LiFePO4 is stable, doesn’t burst into flames, makes for a very good deep cycle battery.
No battery likes the cold, but you can discharge LiFePO4 batteries when they are frozen. But if you try to charge one while frozen, it will be damaged. Some of them have thermal protection, some even have heaters in them. I don’t fish in freezing weather so I don’t worry about it.
Also, I would not choose a LiFePO4 battery for a starting battery. As I posted earlier, they can shutdown if you pull too many amps and they have been known to damage alternators because of the BMS switching. A cheap lead acid makes a better starting bat.
I have a small AGM battery in my boat for starting and only for starting. Everything else runs on LiFePO4. In a pinch a LiFePO4 could start my main, it’s only 60hp, but I would not leave it connected.