FIRE is alluring to many people. After all, who wouldn't want to retire 2 or 3 decades earlier? Well, there are some downsides as well. Find them out here.