You don't have an aphid "problem;" you've got a ladybug deficiency.
Are your aphids experiencing a population explosion? Chemical eradication is out. Harmony is in. Let the aphids show you which plants need some nutritional support, but make sure you're providing habitat for predatory species (planting forage crops, such as clover, make it easy to build up reserviors of beneficial insects).