The former head of China's internet regulator is under investigation for suspected graft, the ruling party said Tuesday.