First, you're not likely to save any money in taxes by incorporating in Delaware. If your business makes money from operations in your home state, you still must pay your own state's income taxes on this income.
Second, while incorporation fees may be lower in Delaware than they are in your home state, you will have to qualify to do business in your state in addition to incorporating in Delaware. This process takes as much time and costs as much money as filing incorporation papers in your own state. And you would also need to appoint a corporate agent to receive official notices in Delaware -- another cost you'd have to bear.
Your best approach is probably to stay where you are and incorporate in your home state.