Inclusion
Documented informed consent of the participant and/or legally authorized representative (brown)
Assent, when appropriate, will be obtained per institutional guidelines
Note: For research participants who do not speak English, a short form consent may be used with a City of Hope (COH) certified interpreter/translator to proceed with screening and leukapheresis, while the request for a translated main consent is processed. However, the research participant is allowed to proceed with lymphodepletion and CAR T cell infusion only after the translated main consent form is signed
Agreement to allow the use of archival tissue from diagnostic tumor biopsies
If unavailable, exceptions may be granted with study principal investigator (PI) approval
Age: \>= 18 years
Eastern Cooperative Oncology Group (ECOG) performance status 0-2 or Karnofsky Performance Status (KPS) \>= 70%
Documented castration resistant prostate cancer (mCRPC) (Note: castration will be defined by a testosterone \< 50 ng/dL achieved by orchiectomy or luteinizing hormone-releasing hormone \[LHRH\] agonist/antagonist therapy)
Documented PSCA+ tumor expression as evaluated by the COH Pathology Clinical Trials Specimen Qualification Laboratory (CTSQL)
Fresh or archival biopsy samples may be tested for PSCA expression during screening for eligibility purposes. The results from soft tissue biopsies will be used to confirm eligibility for participants who have a soft-tissue lesion biopsy obtained, but bone biopsy staining results will not impact eligibility since immunohistochemistry (IHC) staining for PSCA has not been optimized in bone specimens. Subjects who undergo bone biopsy on study will be qualified based on the archival tissue result
Progression of disease manifest by one of the following means during treatment with at least one advanced androgen targeted therapy (e.g., abiraterone or enzalutamide):
Rising prostate specific antigen (PSA) documented on 2 occasions at least 7 days apart, with absolute increase \> 2 ng/dL despite testosterone \< 50 OR
Radiographic evidence of new metastatic foci on CT or bone scan, or soft tissue progression by Response Evaluation Criteria in Solid Tumors (RECIST)
For treatment plan 2, subjects must have at least one and up to 3 metastatic lesions which have not previously been radiated and which is safe for treatment with radiation 16 gray (Gy) in 2 fractions
Fully recovered from the acute toxic effects (except alopecia) to =\< grade 1 to prior anti-cancer therapy
If there has been prior chemotherapy, at least 2 weeks must have elapsed prior to leukapheresis
Prior radiotherapy is allowed provided it was not administered to the only evaluable site of disease and was completed \> 14 days prior to leukapheresis
No known contraindications to leukapheresis, steroids or tocilizumab
Absolute neutrophil count (ANC) \>= 1,000/mm\^3 (within 42 days prior to enrollment)
NOTE: Growth factor is not permitted within 14 days of ANC assessment
Platelets \>= 100,000/mm\^3 (within 42 days prior to enrollment) NOTE: Platelet transfusions are not permitted within 14 days of platelet assessment
Total serum bilirubin =\< 2.0 mg/dL (within 42 days prior to enrollment)
Patients with Gilbert syndrome may be included if their total bilirubin is =\< 3.0 x upper limit of normal (ULN) and direct bilirubin =\< 1.5 x ULN
Aspartate aminotransferase (AST) =\< 2.5 x ULN (within 42 days prior to enrollment)
Alanine aminotransferase (ALT) =\< 2.5 x ULN (within 42 days prior to enrollment)
Creatinine clearance of \>= 50 mL/min per 24 hour urine test or the Cockcroft-Gault formula (within 42 days prior to enrollment)
Corrected QT interval (QTc) =\< 480 ms
Note: to be performed within 28 days prior to day 1 of protocol therapy
Cardiac function (12 lead- electrocardiogram \[ECG\]) without acute abnormalities requiring investigation or intervention (within 42 days prior to enrollment)
Seronegative for human immunodeficiency virus (HIV) antigen (Ag)/antibody (Ab) combo, hepatitis C virus (HCV), active hepatitis B virus (HBV) (surface antigen negative), and syphilis (rapid plasma reagin \[RPR\])
If positive, hepatitis C ribonucleic acid (RNA) quantitation must be performed OR
If seropositive for HIV, HCV or HBV, nucleic acid quantitation must be performed. Viral load must be undetectable
Note infectious disease testing to be performed within 28 days prior to day 1 of protocol therapy
Meets other institutional and federal requirements for infectious disease titer requirements
Note Infectious disease testing to be performed within 28 days prior to day 1 of protocol therapy
Agreement by males of childbearing potential to use an effective method of birth control or abstain from heterosexual activity for the course of the study through at least 3 months after the last dose of protocol therapy
Childbearing potential defined as not being surgically sterilized
Exclusion
Concurrent use of systemic steroids or chronic use of immunosuppressant medications. Recent or current use of inhaled steroids is not exclusionary. Physiologic replacement of steroids (prednisone =\< 7.5 mg /day, or hydrocortisone =\< 20 mg /day) is allowed
Subjects with clinically significant arrhythmia or arrhythmias not stable on medical management within two weeks of screening
Subjects with a known history or prior diagnosis of optic neuritis or other immunologic or inflammatory disease affecting the central nervous system, including seizure disorder
History of allergic reactions attributed to compounds of similar chemical or biologic composition to study agent
Known bleeding disorders (e.g., von Willebrand's disease) or hemophilia
History of stroke or intracranial hemorrhage within 6 months prior to screening
History of other malignancies, except for malignancy surgically resected (or treated with other modalities) with curative intent, basal cell carcinoma of the skin or localized squamous cell carcinoma of the skin; non-muscle invasive bladder cancer; malignancy treated with curative intent with no known active disease present for \>= 3 years
Clinically significant uncontrolled illness
Active infection requiring antibiotics
Known history of immunodeficiency virus (HIV) or hepatitis B or hepatitis C infection
Any other condition that would, in the Investigator's judgment, contraindicate the patient's participation in the clinical study due to safety concerns with clinical study procedures
Prospective participants who, in the opinion of the investigator, may not be able to comply with all study procedures (including compliance issues related to feasibility/logistics)