In the old days, people use all sort of materials to build circuit. For example, heated gas, vacuum tubes.Suddenly in 1947, "solid state" transistor was born in Bell lab, and later circuits were built with these solid state transistors, and they are called solid state circuits.
Basically, solid state means semiconductor based circuits. No gass, no liquid, no vacuum tube.