What is duffer? What is duffer? Informal An incompetent or dull-witted person.Informal A casual or mediocre player of a sport, especially golf.Slang A peddler of cheap merchandise.Slang Something worthless or useless.