Historically, this particular spice has seen more use as a coloring agent than as food itself. The dark red pericarp around the seed was ground into a paste and used for makeup and lipstick by South and Central American tribes. Thus annatto’s nickname: the lipstick tree.