The Ficus carica polysaccharide (FCPS) components of the common fig fruit have been demonstrated to exhibit antioxidant and immunity-enhancing activities. However, it is unclear whether it could prevent the ulcerative colitis development. Here, we reported that 5 week orally administered FCPS (150–300 mg per kg bw) significantly prevented DSS-induced colitis in C57BL/6J mice by improving the colon length and suppressing the infiltration of inflammatory cells in the gut. FCPS treatment protected the goblet cells, elevated the expression of tight junction protein claudin-1, and suppressed the formation of cytokines including TNF-α and IL-1β. FCPS supplementation significantly reformed the gut microbiome by enhancing the abundance of S24-7, Bacteroides, and Coprococus, and suppressing the abundance of Escherichia and Clostridium at the genus level. Consistently, the formation of beneficial microbial metabolites, short chain fatty acids, especially acetate and butyrate, were improved in FCPS-treated colitis mice. The correlation analysis indicated that the protective effects of FCPS on ulcerative colitis might be highly correlated with the microbiota composition changes and the formation of SCFAs. In conclusion, these results indicated that FCPS supplementation could be a promising nutritional strategy for reducing inflammatory bowel disease and the gut microbes play essential roles in providing these beneficial effects.