Born and raised in Marlboro, Maryland, Victor played high school basketball at DeMatha. As a senior he led his high school to a 32-4 record and to the Washington Catholic Athletic Conference and City Championships. He was nationally ranked for both overall and shooting guard categories. He chose to take his basketball skills to Indiana University turning down offers from many other top-ranked colleges. During his second season as a Hoosier, he was known for being one of the most improved players and the team's best defender. In his last year at Indiana, he ranked 4th in the country in field-goal percentage. He was named Sporting News Men's College Basketball Player of the Year, National Co-Defensive Player of the Year, First Team All-Big Ten and Big Ten Defensive Player of the Year. He entered the 2013 NBA Draft and was selected 2nd overall by the Orlando Magic, which he currently plays for. Victor was named to the 2013-2014 All Rookie First Team.