You arrive at a traffic signal that is broken; none of its lights are on. What should you do?

When the traffic signals are not working, treat the intersection as an all-way stop. You must stop, yield, and only proceed (with extreme caution) when it is safe to do so. [Traffic Signals, Chapter 10: Traffic Signals and Pavement Markings, Illinois Rules of the Road]