Fluoride-Ion Batteries (FIBs) have been recently proposed as a post-lithium-ion battery system. This review article presents recent progress of the synthesis and application aspects of the cathode, electrolyte, and anode materials for fluoride-ion batteries. In this respect, improvements in solid-state electrolytes for FIBs as well as liquid electrolytes will be discussed. Furthermore, the achievements regarding the development of cathode and anode materials will be considered. With the improvements made, the field is currently attracting a steady increase of interest, and we will discuss the potentials of this technology together with necessary future milestones to be achieved in order to develop FIBs for future energy storage.