The old-school theory of avoiding sweet food as a first food to shape baby's taste preferences has never been proven. For better or for worse, babies preference for sweets is innate and universal.
Bananas are naturally sweet and soft, two features that babies seem to love. Mashed, sliced, or whole, babies often get really psyched when they are offered this fruit as a first food.