Wrap your ListBox in a Grid and set it's VerticalAlignment="Top"
It sounds like your ListBox control is inside another element such as a Grid or DockPanel, which by default stretches it's children to fill all available space.
<Grid><ListBox VerticalAlignment="Top" ... /></Grid>