For indoor visible light communication system, the layout of light-emitting diode light sources affects the illuminance uniformity (UIR) and communication reliability of the system. We took a 5 m×4 m×3 m room as the model. The annular light source layout is designed and compared with the traditional circular layout. The simulation results show that the illuminance performance and communication performance of the annular layout are better. The genetic-ant colony hybrid algorithm is used to optimize the position and power of the light source of the annular layout. The UIR and quality factor Q are improved by 15.49% and 61.39% after optimization, respectively. Then, an experimental system of annular layout is built. Compared with the simulation results, the error of UIR obtained by the experiment is 4.21%. The equipment for the illuminance test is also used to connect to an indoor visible video transmission system, which proves the feasibility of an annular light source layout.