Connect with us

Uncategorized

Scientists created ‘OpinionGPT’ to explore explicit human bias — and you can test it for yourself

Due to the nature of the model’s tuning data, it’s unclear whether this system is actually capable of generating outputs showing real-world bias.

Published

on

Due to the nature of the model's tuning data, it's unclear whether this system is actually capable of generating outputs showing real-world bias.

A team of researchers from Humboldt-Universitat zu Berlin have developed a large language artificial intelligence model with the distinction of having been intentionally tuned to generate outputs with expressed bias.

Called OpinionGPT, the team’s model is a tuned variant of Meta’s Llama 2, an AI system similar in capability to OpenAI’s ChatGPT or Anthropic’s Claude 2.

Using a process called instruction-based fine-tuning, OpinionGPT can purportedly respond to prompts as if it were a representative of one of 11 bias groups: American, German, Latin American, Middle Eastern, a teenager, someone over 30, an older person, a man, a woman, a liberal, or a conservative.

OpinionGPT was refined on a corpus of data derived from “AskX” communities, called subreddits, on Reddit. Examples of these subreddits would include “Ask a Woman” and “Ask an American.”

The team started by finding subreddits related to the 11 specific biases and pulling the 25-thousand most popular posts from each one. They then retained only those posts that met a minimum threshold for upvotes, did not contain an embedded quote, and were under 80 words.

With what was left, it appears as though they used an approach similar to Anthropic’s Constitutional AI. Rather than spin up entirely new models to represent each bias label, they essentially fine-tuned the single 7 billion-parameter Llama2 model with separate instruction sets for each expected bias.

Related: AI usage on social media has potential to impact voter sentiment

The result, based upon the methodology, architecture, and data described in the German team’s research paper, appears to be an AI system that functions as more of a stereotype generator than a tool for studying real world bias.

Due to the nature of the data the model has been refined on, and that data’s dubious relation to the labels defining it, OpinionGPT doesn’t necessarily output text that aligns with any measurable real-world bias. It simply outputs text reflecting the bias of its data.

The researchers themselves recognize some of the limitations this places on their study, writing:

“For instance, the responses by "Americans" should be better understood as 'Americans that post on Reddit,' or even 'Americans that post on this particular subreddit.' Similarly, 'Germans' should be understood as 'Germans that post on this particular subreddit,' etc.”

These caveats could further be refined to say the posts come from, for example, “people claiming to be Americans who post on this particular subreddit,” as there’s no mention in the paper of vetting whether the posters behind a given post are in fact representative of the demographic or bias group they claim to be.

The authors go on to state that they intend to explore models that further delineate demographics (ie: liberal German, conservative German).

The outputs given by OpinionGPT appear to vary between representing demonstrable bias and wildly differing from the established norm, making it difficult to discern its viability as a tool for measuring or discovering actual bias.

Source: Screenshot, Table 2: Haller et. al., 2023

According to OpinionGPT, as shown in the above image, for example, Latin Americans are biased towards basketball being their favorite sport.

Empirical research, however, clearly indicates that football (also called soccer in some countries) and baseball are the most popular sports by viewership and participation throughout Latin America.

The same table also shows that OpinionGPT outputs “water polo” as its favorite sport when instructed to give the “response of a teenager,” an answer that seems statistically unlikely to be representative of most 13-19 year olds around the world.

The same goes for the idea that an average American’s favorite food is “cheese.” We found dozens of surveys online claiming that pizza and hamburgers were America’s favorite foods, but couldn’t find a single survey or study that claimed Americans' number one dish was simply cheese.

While OpinionGPT might not be well-suited for studying actual human bias, it could be useful as a tool for exploring the stereotypes inherent in large document repositories such as individual subreddits or AI training sets.

For those who are curious, the researchers have made OpinionGPT available online for public testing. However, according to the website, would-be users should be aware that “generated content can be false, inaccurate, or even obscene.”

Read More

Continue Reading

Uncategorized

The hostility Black women face in higher education carries dire consequences

9 Black women who were working on or recently earned their PhDs told a researcher they felt isolated and shut out.

Published

on

By

Isolation can make opportunities elusive. fotostorm via Getty Images

Isolated. Abused. Overworked.

These are the themes that emerged when I invited nine Black women to chronicle their professional experiences and relationships with colleagues as they earned their Ph.D.s at a public university in the Midwest. I featured their writings in the dissertation I wrote to get my Ph.D. in curriculum and instruction.

The women spoke of being silenced.

“It’s not just the beating me down that is hard,” one participant told me about constantly having her intelligence questioned. “It is the fact that it feels like I’m villainized and made out to be the problem for trying to advocate for myself.”

The women told me they did not feel like they belonged. They spoke of routinely being isolated by peers and potential mentors.

One participant told me she felt that peer community, faculty mentorship and cultural affinity spaces were lacking.

Because of the isolation, participants often felt that they were missing out on various opportunities, such as funding and opportunities to get their work published.

Participants also discussed the ways they felt they were duped into taking on more than their fair share of work.

“I realized I had been tricked into handling a two- to four-person job entirely by myself,” one participant said of her paid graduate position. “This happened just about a month before the pandemic occurred so it very quickly got swept under the rug.”

Why it matters

The hostility that Black women face in higher education can be hazardous to their health. The women in my study told me they were struggling with depression, had thought about suicide and felt physically ill when they had to go to campus.

Other studies have found similar outcomes. For instance, a 2020 study of 220 U.S. Black college women ages 18-48 found that even though being seen as a strong Black woman came with its benefits – such as being thought of as resilient, hardworking, independent and nurturing – it also came at a cost to their mental and physical health.

These kinds of experiences can take a toll on women’s bodies and can result in poor maternal health, cancer, shorter life expectancy and other symptoms that impair their ability to be well.

I believe my research takes on greater urgency in light of the recent death of Antoinette “Bonnie” Candia-Bailey, who was vice president of student affairs at Lincoln University. Before she died by suicide, she reportedly wrote that she felt she was suffering abuse and that the university wasn’t taking her mental health concerns seriously.

What other research is being done

Several anthologies examine the negative experiences that Black women experience in academia. They include education scholars Venus Evans-Winters and Bettina Love’s edited volume, “Black Feminism in Education,” which examines how Black women navigate what it means to be a scholar in a “white supremacist patriarchal society.” Gender and sexuality studies scholar Stephanie Evans analyzes the barriers that Black women faced in accessing higher education from 1850 to 1954. In “Black Women, Ivory Tower,” African American studies professor Jasmine Harris recounts her own traumatic experiences in the world of higher education.

What’s next

In addition to publishing the findings of my research study, I plan to continue exploring the depths of Black women’s experiences in academia, expanding my research to include undergraduate students, as well as faculty and staff.

I believe this research will strengthen this field of study and enable people who work in higher education to develop and implement more comprehensive solutions.

The Research Brief is a short take on interesting academic work.

Ebony Aya received funding from the Black Collective Foundation in 2022 to support the work of the Aya Collective.

Read More

Continue Reading

Uncategorized

US Economic Growth Still Expected To Slow In Q1 GDP Report

A new round of nowcasts continue to estimate that US economic activity will downshift in next month’s release of first-quarter GDP data. Today’s revised…

Published

on

A new round of nowcasts continue to estimate that US economic activity will downshift in next month’s release of first-quarter GDP data. Today’s revised estimate is based on the median for a set of nowcasts compiled by CapitalSpectator.com.

Output for the January-through-March period is currently projected to soften to a 2.1% increase (seasonally adjusted annual rate). The estimate reflects a substantially softer rise vs. Q4’s strong 3.2% advance, which in turn marks a downshift from Q3’s red-hot 4.9% increase, according to government data.

Today’s revised Q1 estimate was essentially unchanged from the previous Q1 nowcast (published on Mar. 7). At this late date in the current quarter, the odds are relatively high that the current median estimate is a reasonable guesstimate for the actual GDP data that the Bureau of Economic Analysis will publish in late-April.

GDP rising at roughly a 2% pace marks another slowdown from recent quarters, but if the current nowcast is correct it suggests that recession risk remains low. The question is whether the slowdown persists into Q2 and beyond. Given the expected deceleration in growth on tap for Q1, the economy may be flirting with a tipping point for recession later in the year. It’s premature to make such a forecast with high confidence, but it’s a scenario that’s increasingly plausible, albeit speculatively so for now.

Yesterday’s release of retail sales numbers for February aligns with the possibility that even softer growth is coming. Although spending rebounded last month after January’s steep decline, the bounce was lowr than expected.

“The modest rebound in retail sales in February suggests that consumer spending growth slowed in early 2024,” says Michael Pearce, Oxford Economics deputy chief US economist.

Reviewing retail spending on a year-over-year basis provides a clearer view of the softer-growth profile. The pace edged up to 1.5% last month vs. the year-earlier level, but that’s close to the slowest increase in the post-pandemic recovery.

Despite emerging signs of slowing growth, relief for the economy in the form of interest-rate cuts may be further out in time than recently expected, due to the latest round of sticky inflation news this week.

“When the Fed is contemplating a series of rate cuts and is confronted by suddenly slower economic growth and suddenly brisker inflation, they will respond to the new news on the inflation side every time,” says Chris Low, chief economist at FHN Financial. “After all, this is not the first time in the past couple of years consumers have paused spending for a couple of months to catch their breath.”


How is recession risk evolving? Monitor the outlook with a subscription to:
The US Business Cycle Risk Report


Read More

Continue Reading

Uncategorized

Key shipping company files for Chapter 11 bankruptcy

The Illinois-based general freight trucking company filed for Chapter 11 bankruptcy to reorganize.

Published

on

The U.S. trucking industry has had a difficult beginning of the year for 2024 with several logistics companies filing for bankruptcy to seek either a Chapter 7 liquidation or Chapter 11 reorganization.

The Covid-19 pandemic caused a lot of supply chain issues for logistics companies and also created a shortage of truck drivers as many left the business for other occupations. Shipping companies, in the meantime, have had extreme difficulty recruiting new drivers for thousands of unfilled jobs.

Related: Tesla rival’s filing reveals Chapter 11 bankruptcy is possible

Freight forwarder company Boateng Logistics joined a growing list of shipping companies that permanently shuttered their businesses as the firm on Feb. 22 filed for Chapter 7 bankruptcy with plans to liquidate.

The Carlsbad, Calif., logistics company filed its petition in the U.S. Bankruptcy Court for the Southern District of California listing assets up to $50,000 and and $1 million to $10 million in liabilities. Court papers said it owed millions of dollars in liabilities to trucking, logistics and factoring companies. The company filed bankruptcy before any creditors could take legal action.

Lawsuits force companies to liquidate in bankruptcy

Lawsuits, however, can force companies to file bankruptcy, which was the case for J.J. & Sons Logistics of Clint, Texas, which on Jan. 22 filed for Chapter 7 liquidation in the U.S. Bankruptcy Court for the Western District of Texas. The company filed bankruptcy four days before the scheduled start of a trial for a wrongful death lawsuit filed by the family of a former company truck driver who had died from drowning in 2016.

California-based logistics company Wise Choice Trans Corp. shut down operations and filed for Chapter 7 liquidation on Jan. 4 in the U.S. Bankruptcy Court for the Northern District of California, listing $1 million to $10 million in assets and liabilities.

The Hayward, Calif., third-party logistics company, founded in 2009, provided final mile, less-than-truckload and full truckload services, as well as warehouse and fulfillment services in the San Francisco Bay Area.

The Chapter 7 filing also implemented an automatic stay against all legal proceedings, as the company listed its involvement in four legal actions that were ongoing or concluded. Court papers reportedly did not list amounts for damages.

In some cases, debtors don't have to take a drastic action, such as a liquidation, and can instead file a Chapter 11 reorganization.

Truck shipping products.

Shutterstock

Nationwide Cargo seeks to reorganize its business

Nationwide Cargo Inc., a general freight trucking company that also hauls fresh produce and meat, filed for Chapter 11 bankruptcy protection in the U.S. Bankruptcy Court for the Northern District of Illinois with plans to reorganize its business.

The East Dundee, Ill., shipping company listed $1 million to $10 million in assets and $10 million to $50 million in liabilities in its petition and said funds will not be available to pay unsecured creditors. The company operates with 183 trucks and 171 drivers, FreightWaves reported.

Nationwide Cargo's three largest secured creditors in the petition were Equify Financial LLC (owed about $3.5 million,) Commercial Credit Group (owed about $1.8 million) and Continental Bank NA (owed about $676,000.)

The shipping company reported gross revenue of about $34 million in 2022 and about $40 million in 2023.  From Jan. 1 until its petition date, the company generated $9.3 million in gross revenue.

Related: Veteran fund manager picks favorite stocks for 2024

Read More

Continue Reading

Trending