As a film character actor, Klugman was the epitome of the everyman. He was one of the pioneers of television acting in the 1950s, and is best remembered for his 1970s TV work as Oscar Madison on "The Odd Couple" (1970) and as the medical examiner on "Quincy M.E." (1976).
| Movie | Beyond a Reasonable Doubt: Making '12 Angry Men' | Self | 2008-03-04 |
| Movie | When Do We Eat? | Artur | 2006-04-07 |
| Series | Living in TV Land | Unknown | 2004-08-18 |
| Series | The Tony Danza Show | 2004-09-13 | |
| Series | Presidio Med | Unknown | 2002-09-24 |
| Series | Crossing Jordan | Unknown | 2001-09-24 |
| Series | Third Watch | Stan Brandolini | 1999-09-23 |
| Series | Brother's Keeper | Unknown | 1998-09-24 |
| Series | The Rosie O'Donnell Show | Unknown | 1996-06-10 |
| Movie | Dear God | Jemi | 1996-11-01 |
| Movie | The Twilight of the Golds | Mr. Stein | 1996-10-10 |
| Movie | Shining Time Station: Second Chances | Max Okowsky | 1995-09-25 |
| Series | Die Harald Schmidt Show | Unknown | 1995-12-05 |
| Movie | Parallel Lives | Senator Robert Ferguson | 1994-08-04 |
| Series | Late Night with Conan O'Brien | Unknown | 1993-09-13 |
| Movie | The Odd Couple: Together Again | Oscar Madison | 1993-09-24 |
| Series | Diagnosis: Murder | Unknown | 1993-10-29 |
| Series | Intimate Portrait | Unknown | 1993-11-14 |
| Series | Shining Time Station | Unknown | 1989-01-29 |
| Series | Around the World in 80 Days | Captain Bunsby | 1989-04-16 |
| Series | You Again? | Henry Willows | 1986-02-27 |
| Series | Larry King Live | Unknown | 1985-06-03 |
| Series | This Is Your Life | Unknown | 1983-09-24 |
| Movie | Night of 100 Stars | Self | 1982-03-08 |
| Movie | Challenge of the Tiger | Jack Klugman (cameo / uncredited) | 1980-01-01 |
| Movie | Lucy Moves to NBC | Self | 1980-02-08 |
| Series | The Love Boat | Unknown | 1977-09-24 |
| Movie | One of My Wives Is Missing | Inspector Murray Levine | 1976-03-05 |
| Series | Quincy, M.E. | Quincy | 1976-10-03 |
| Movie | Two-Minute Warning | Stu Sandmann | 1976-11-12 |
| Movie | The Underground Man | Sheriff Tremaine | 1974-05-06 |
| Movie | Poor Devil | Burnett J. Emerson | 1973-02-14 |
| Series | The Dean Martin Celebrity Roasts | Unknown | 1973-09-14 |
| Series | Banyon | Unknown | 1972-09-15 |
| Movie | Who Says I Can't Ride a Rainbow! | Barney | 1971-11-18 |
| Series | He Said, She Said | Unknown | 1970-07-27 |
| Series | The Odd Couple | Oscar Madison | 1970-09-24 |
| Movie | Goodbye, Columbus | Ben Patimkin | 1969-04-03 |
| Series | The Bold Ones: The New Doctors | Unknown | 1969-09-14 |
| Series | Love, American Style | Unknown | 1969-09-29 |
| Series | Then Came Bronson | Unknown | 1969-09-17 |
| Movie | The Detective | Dave Schoenstein | 1968-05-28 |
| Series | Rowan & Martin's Laugh-In | Unknown | 1968-01-22 |
| Movie | The Split | Harry Kifka | 1968-11-04 |
| Series | The Name of the Game | Unknown | 1968-09-20 |
| Series | Garrison's Gorillas | Unknown | 1967-09-06 |
| Movie | Fame Is the Name of the Game | Ben Welcome | 1966-11-26 |
| Movie | Hail! Mafia | Phil | 1965-08-10 |
| Series | The F.B.I. | Unknown | 1965-09-19 |
| Series | Harris Against the World | Alan Harris | 1964-10-05 |
| Movie | The Yellow Canary | Lt. Bonner | 1963-05-15 |
| Movie | I Could Go on Singing | George | 1963-03-07 |
| Movie | Days of Wine and Roses | Jim Hungerford | 1963-02-04 |
| Series | Arrest and Trial | Unknown | 1963-09-15 |
| Series | The Fugitive | Unknown | 1963-09-17 |
| Series | Kraft Suspense Theatre | Unknown | 1963-10-10 |
| Series | Bob Hope Presents the Chrysler Theatre | Unknown | 1963-10-04 |
| Series | The Great Adventure | Unknown | 1963-09-27 |
| Movie | Act One | Joe Hyman | 1963-12-26 |
| Series | The Virginian | Unknown | 1962-09-19 |
| Series | The Tonight Show Starring Johnny Carson | Unknown | 1962-10-01 |
| Series | Follow the Sun | Unknown | 1961-09-17 |
| Series | The Defenders | Unknown | 1961-09-16 |
| Series | Target: The Corruptors! | Unknown | 1961-09-29 |
| Series | Cain's Hundred | Unknown | 1961-09-19 |
| Series | The New Breed | Unknown | 1961-10-03 |
| Series | Ben Casey | Unknown | 1961-10-02 |
| Series | Straightaway | Unknown | 1961-10-06 |
| Series | Insight | Unknown | 1960-10-02 |
| Series | The Twilight Zone | Max Phillips | 1959-10-02 |
| Movie | The Velvet Alley | Max Salter | 1959-01-22 |
| Series | The | Unknown | 1958-06-03 |
| Movie | Cry Terror! | Vince | 1958-05-02 |
| Series | Naked City | Unknown | 1958-09-30 |
| Movie | Kiss Me, Kate | Gunman | 1958-11-20 |
| Movie | 12 Angry Men | Juror 5 | 1957-04-10 |
| Series | Richard Diamond, Private Detective | Unknown | 1957-07-01 |
| Series | The Walter Winchell File | Unknown | 1957-10-02 |
| Series | Suspicion | Unknown | 1957-09-30 |
| Movie | Time Table | Frankie Page | 1956-02-08 |
| Movie | Marty | Bar Patron (uncredited) | 1955-04-11 |
| Series | The Alcoa Hour | Unknown | 1955-10-16 |
| Series | Gunsmoke | Unknown | 1955-09-10 |
| Series | Alfred Hitchcock Presents | Unknown | 1955-10-02 |
| Series | Justice | Unknown | 1954-04-08 |
| Series | Inner Sanctum | Unknown | 1954-01-09 |
| Series | The Greatest Gift | 1954-08-30 | |
| Series | Producers' Showcase | Unknown | 1954-10-18 |
| Series | General Electric Theater | Unknown | 1953-02-01 |
| Series | Colonel Humphrey Flack | Unknown | 1953-10-07 |
| Series | The United States Steel Hour | Unknown | 1953-10-27 |
| Movie | Grubstake | 1952-01-01 | |
| Series | Goodyear Television Playhouse | Unknown | 1951-10-14 |
| Series | Hallmark Hall of Fame | Unknown | 1951-12-24 |
| Series | Treasury Men in Action | Unknown | 1950-09-11 |
| Series | Inside Detective | Unknown | 1950-01-07 |
| Series | Actors Studio | Unknown | 1948-09-26 |
| Series | Studio One | Unknown | 1948-11-07 |
| Series | The Philco Television Playhouse | Unknown | 1948-10-03 |