Glad you asked! To delete an application from your device, hold your finger on the icon you wish to remove for a few seconds.
Once you have held your finger down long enough, the icon will begin to jiggle, now simply press the 'X' in the corner of that icon. Confirm on the following prompt that you wish to delete.
Press the Home button to resume normal operation, the application has now been deleted.