The first $2 notes were issued in 1862 and had a portrait of the first Secretary of the Treasury, Alexander Hamilton.   The Federal Reserve System ("The Fed") is the central bank of the United States. The Fed is a bank for other banks and the federal government.