Well, Did some reading on Duke blueberries and it is not self fertile, so I popped out to the local Lowes and picked up a decent sized Hardiblue blueberry which will cross pollinate with the Duke. Planted it about 6 feet from the other one, so we'll see how they do.
There is a definite lack of pollinating insects in this area even though there is a ton of scotch bonnet blooming now. Or the insects are all drawn to he Scotch bonnet and are ignoring the smaller plants like blueberries now. Not sure. I am going to look into getting some Orchard Mason Bees here.