• Financial System
  • OA
  • Bidding
  • Email
  • 简体中文
  • About Us
    • Overview
    • History
    • Organization
    • Our Team
      • Management
      • Research & Development
      • Functional Personnel
  • Research Divisions
    • Division of Fundamental Research
    • Center for General Software and Technologies of Big Data
      • Optimization Solver Development Laboratory
    • Center for Big Data Applications and Technologies
      • Data-driven Intelligent Information System Laboratory
      • Medical Big Data Laboratory
      • Human Language Technology Laboratory
      • Laboratory for Smart City, Transportation and Logistics Big Data
      • Laboratory for Public and Commercial Big Data
      • Shenzhen International Center for Industrial and Applied Mathematics (SICIAM) 
  • Our Research
    • R&D Projects
    • Educational Programs
      • CUHKSZ-SRIBD Joint PhD&Postdoc Programs
      • Scholarship Program
    • Seminars & Conferences
  • News
    • SRIBD News
    • MIIS
    • Audios & Videos
      • Videos
      • Periodicals
  • Recruiting
    • Reserach Scientist
    • Engineer
    • Administration Staff
    • Recruitment Overview
  • Contact Us
    • Inquiry
    • Public Relations
    • Cooperation
  • About Us
    • Overview
    • History
    • Organization
    • Our Team
      • Management
      • Research & Development
      • Functional Personnel
  • Research Divisions
    • Division of Fundamental Research
    • Center for General Software and Technologies of Big Data
      • Optimization Solver Development Laboratory
    • Center for Big Data Applications and Technologies
      • Data-driven Intelligent Information System Laboratory
      • Medical Big Data Laboratory
      • Human Language Technology Laboratory
      • Laboratory for Smart City, Transportation and Logistics Big Data
      • Laboratory for Public and Commercial Big Data
      • Shenzhen International Center for Industrial and Applied Mathematics (SICIAM) 
  • Our Research
    • R&D Projects
    • Educational Programs
      • CUHKSZ-SRIBD Joint PhD&Postdoc Programs
      • Scholarship Program
    • Seminars & Conferences
  • News
    • SRIBD News
    • MIIS
    • Audios & Videos
      • Videos
      • Periodicals
  • Recruiting
    • Reserach Scientist
    • Engineer
    • Administration Staff
    • Recruitment Overview
  • Contact Us
    • Inquiry
    • Public Relations
    • Cooperation
  • Financial System
  • OA
  • Bidding
  • Email
  • 简体中文
  • About Us
    • Overview
    • History
    • Organization
    • Our Team
      • Management
      • Research & Development
      • Functional Personnel
  • Research Divisions
    • Division of Fundamental Research
    • Center for General Software and Technologies of Big Data
      • Optimization Solver Development Laboratory
    • Center for Big Data Applications and Technologies
      • Data-driven Intelligent Information System Laboratory
      • Medical Big Data Laboratory
      • Human Language Technology Laboratory
      • Laboratory for Smart City, Transportation and Logistics Big Data
      • Laboratory for Public and Commercial Big Data
      • Shenzhen International Center for Industrial and Applied Mathematics (SICIAM) 
  • Our Research
    • R&D Projects
    • Educational Programs
      • CUHKSZ-SRIBD Joint PhD&Postdoc Programs
      • Scholarship Program
    • Seminars & Conferences
  • News
    • SRIBD News
    • MIIS
    • Audios & Videos
      • Videos
      • Periodicals
  • Recruiting
    • Reserach Scientist
    • Engineer
    • Administration Staff
    • Recruitment Overview
  • Contact Us
    • Inquiry
    • Public Relations
    • Cooperation

Breadcrumb

  • Home
  • Our Research
  • R&D Projects
  • An efficient black-box attack in real-world scenarios

An efficient black-box attack in real-world scenarios

Mar 24,2023 Projects

Project description/goals

This project studies black-box adversarial attacks against deep neural networks (DNNs), where the attacker can only access the query feedback returned by the attacked API, while other information such as model parameters or the training datasets are unknown. In order to protect the security of services which are provided by Tencent, it is necessary to research on black-box adversarial attacks. The proposed attack could be the baseline of security test, and we will design method to defense it.

Importance/impact, challenges/pain points

AI technology has been widely used in Tencent's products and services, such as face recognition, image recognition and other products provided by Tencent Cloud, which provide services to users in the form of API. However, malicious attackers can steal, cheat or leak models’ training data in a black-box attack. Once the attack is achieved, Tencent will suffer from incalculable economic and reputational losses. Therefore, in order to ensure the security of Tencent services, it is necessary to study efficient black-box attacks in real-world scenarios. In addition, the existing defenses have their own shortcomings, such as query, migration, query and migration combination.

Solution description

The solution is to develop an efficient black-box attack for real-world scenarios. First, we could map the simple normal distribution to a complex distribution. Then, we use the efficient training method on surrogate models. Finally, we transfer the mapping parameter to the model trained on surrogate models.

Key contribution/commercial implication

We developed a novel efficient black-box attack based on randomly sampled perturbations.

Next steps

In the next step, we intend to design a defense method to protect models against black-box attacks.

Collaborators/partners

Tencent

Team/contributors

Zeyu Qin    PhD

Mingli Zhu  PhD

Yaopei Zeng   Mphil

 
Follow Us
  •  
  •  
  •  
  •  
  • Contact Us
    • Inquiry
    • Public Relations
    • Cooperation
  • Collaborative Institutions
    • The Chinese University of Hong Kong, Shenzhen
    • National Health Data Institute (Shenzhen)
    • Shenzhen International Center for Industrial and Applied Mathematics

  • Friendly Links
Copyright 2022 All Rights Reserved | 粤ICP备16049670号