Windows > Dockable Dialogs > Palettes
Click on the tiny black arrow icon in the dialog next to Palettes. Choose Palettes Menu > New Palette
Use the foreground colour changer in the toolbox to choose a new colour, click and drag the colour from "current" into your new palette. Repeat until you have all the colours you want.