Here's a simple test to determine your optimal carb intake. You should perform this test doing the same level of physical activity you plan to do after the test. You'll need to adjust upward or downward if you add or increase your activity level in a big way.
STEP 1: Go for a week (or ideally two) with no additional carbs except naturally-occurring carbs in Fibrous Vegetables (see Carb Type Strategy). You will either feel great, or pretty miserable. The next step tells you what to do.
STEP 2: Gradually add carbs back into your diet. Start with Level 6 carbs, and work your way down. Spend 2 - 3 days at each level. (Note that the impact of carbs varies depending on how you eat it - see below).
There are ways to eat carbs while minimizing the impact.
Doing either of the above, you could "get away with" eating refined carbs (sugars, bread, pasta, etc...) more easily. It effectively lowers the Glycemic Index (GI) because a large amount of glucose isn't hitting the system; digestion is slowed. The fiber content of whole fruit is why whole fruit has lower GI, but fruit juice has a high GI. You can also handle refined carbs more easily if you eat it in small portions (easier said than done of course).
Another way to reduce impact:
Some people suggest that sugar substitutes are bad, claiming they cause people to eat more food and/or cause hunger. However, research doesn't support that assertion so you should feel free to use them. That said, you should be careful and note how sugar substitutes affects you personally. If it triggers cravings for more or seems to sabotage your goals then obviously you should avoid using them.
Also, you have to look at all the ingredients in anything you're eating, particularly packaged food. Just because it has a zero-calorie sweetener doesn't mean it's not an overall high calorie dense food due to other carbs or fats.