Antigen-specific B cells bifurcate into antibody secreting cells (ASC) and memory B cells after infection or vaccination. ASCs or plasmablasts have been extensively studied in humans but less is known about B cells that get activated but do not differentiate into early plasmablasts. Here, we define the phenotype and transcriptional program of an antigen-specific B cell subset, referred to as activated B cells (ABC), that is distinct from ASCs and is committed to the memory B cell lineage. ABCs were detected in humans after infection with Ebola virus or influenza virus and also after vaccination. By simultaneously analyzing antigen-specific ASCs and ABCs in human blood after influenza vaccination we interrogated the clonal overlap and extent of somatic hypermutation (SHM) in the ASC (effector) and ABC (memory) lineages. Longitudinal tracking of vaccination-induced HA-specific clones revealed minimal increase in SHM over time suggesting that repeated annual immunization may have limitations in enhancing the quality of influenza-specific antibody.