At a public meeting held last week, chairman John McCulloch told residents the £600,000 plans would benefit everyone and give youngsters more opportunities to get involved in sport.
But some worried residents at the meeting said the plans for the town centre site would mean the disappearance of a valued green area and could increase noise and light pollution in the area.
Mr McCulloch said: "This will benefit not just the football club, but the children of the area.
"Kids will be able to play safely. We are trying to provide a facility for the community."
The plans have not yet been submitted to Amber Valley Borough Council, but it is expected the site would have a tarmac multi-use games court, which will be open to the public, and two floodlit areas with artificial turf, which will be surrounded by a 3m steel fence and accessible only through booking.
Residents said they were concerned that the current open space, which is used by dog walkers, and children playing, as well as people playing sports, woulc be lost in the plans.
Ernest Poundall, 69, of Ray Street, said: "We're only looking at a small area we are going to be left with.
"We're not going to have the facilities we have now."
Another resident said during the meeting: "This is a brilliant idea. but it's in the wrong place."
And a show of hands at the end of the meeting revealed that the majority had the same concerns..
It is thought the land was gifted to the town many years ago by Squire Mundy and a covenant says that it should be retained for public use.
The meeting, which was held at the Welfare Centre on Wilmot Street, was organised by Heanor Town Council.
The council still has to have a meeting to discuss the plans and decide on its own recommendation to the planning authority.
Town mayor Cllr Bob Janes said he thought everyone had had a chance to voice their opinions on the proposed project at the meeting.
He added: "Some clear messages came out."