Witnesses saw the small plane go down on Friday evening
The FAA reports it was a World War II vintage P-47 Thunderbolt aircraft
Pilot was pulled from water and suffered minor injuries
It was scheduled to perform this weekend in honor of Fleet Week
Plane still submerged, Coast Guard and NYPD Harbor units on the scene
It is not known how many people are on board the plane