Authorities told KTVU reporter Sara Zendehnam that the shooting happened on Parkmoor Avenue and Race Street, about a mile and a half from San Jose City College.
Officers were called to the scene at about 1:15 a.m., to find a man suffering from at least one gunshot wound.
Video of the scene showed paramedics performing CPR on a man, and then loading him onto the ambulance.
He was later pronounced dead at the hospital.
His identity has not been revealed, and authorities have not yet released a suspect's description.
Police investigators spent hours overnight gathering evidence at the scene.