A benefit of organic foods is that harsh synthetic chemical pesticides are not used. This means that the foods grown on these lands and the animals raised in organic environments would not have these chemicals transferred to the food or animal.
By using this datum we can select out the foods that normally receive or need more pesticides when grown conventionally. Then make these foods the ones you switch to first.
First on the list would be: tomatoes, any of the berry fruits, apples, oranges, lettuce, and milk. Go to your local farmer's market for direct from the farm prices.
Now here is a little tip to save money. Local growers may not be using harsh chemicals for the food they grow for their own families. Any surplus they might sell at the market. Although not technically organic if it is not an organic farm, you would save money and get what the farmer's own family eats.
Meats can also be high in pesticides and hormones that the animal has been in contact with. To save money and still benefit health-wise, look for producers that use no chemicals and hormones. These might not be certified organic producers, but they choose not to use the chemicals.
You may have to ask because they had never thought they should promote it. I found a local producer at my farmer's market that does not use pesticides or hormones. He now has a big sign up and has been written about in the local paper, all after I let him know he needs to let people know.