Gold, silver and sugar. Enslaved Africans were used in the gold workings in New Granada (the country now called Colombia in South America). They were panning for gold in the rivers. By the late 16th century about 1, 000 slaves were bought each year by the Spanish who bought the rights to pan for gold.