Gallium Oxide (Ga₂O₃) has attracted significant research interest for next-generation high-efficiency power devices because of their unique electronic properties such as ultra-wide band gap, high breakdown electric field, and large Baliga's figure of merit. Ga₂O₃ crystallizes in a series of reported polymorphs including β-, α-, ε-, κ-, γ- and δ-Ga₂O₃, the structures of some of which are still in serious controversy. We herein performed a polymorph structure search study of Ga₂O₃ by combining particle swarm optimization with first-principles energetic calculations. In addition to producing the predominant experimental known phases of β-, α- and κ-Ga₂O₃, we found two new polymorphs with space group P-1 and Pmc2₁ consisting of four- and five-fold coordinated Ga. They show comparable energy with β- and α-Ga₂O₃ with the energy difference of several meV/atom, and exhibit robust phonon stability. Similarly, the new phases show quite wide band gaps and small electron effective masses by comparing it with other known phases. The Pmc2₁ phase shows a calculated spontaneous polarization of 0.277 C/m², close to that of ε/κ-Ga₂O₃. Our systemic structure searches also establish a structural relationship between ε-Ga₂O₃ and κ-Ga₂O₃ and how the electronic properties vary with polymorphic phase change.