Optimal Accounting of Differential Privacy via Characteristic Function. Characterizing the privacy degradation over compositions, i.e., privacy accounting, is a fundamental topic in differential privacy (DP) with many applications to differentially private machine learning and federated learning. We propose a unification of recent advances (Renyi DP, privacy profiles, f DP and the PLD formalism) via the emph characteristic function ( phi function) of a certain emph dominating privacy loss random variable. We show that our approach allows emph natural adaptive composition like Renyi DP, provides emph exactly tight privacy accounting like PLD, and can be (often emph losslessly ) converted to privacy profile and f DP, thus providing ( epsilon, delta) DP guarantees and interpretable tradeoff functions. Algorithmically, we propose an emph analytical Fourier accountant that represents the emph complex logarithm of phi functions symbolically and uses Gaussian quadrature for numerical computation. On several popular DP mechanisms and their subsampled counterparts, we demonstrate the flexibility and tightness of our approach in theory and experiments.


Bilinear Scoring Function Search for Knowledge Graph Learning. Learning embeddings for entities and relations in knowledge graph (KG) have benefited many downstream tasks. In recent years, scoring functions, the crux of KG learning, have been human designed to measure the plausibility of triples and capture different kinds of relations in KGs. However, as relations exhibit intricate patterns that are hard to infer before training, none of them consistently perform the best on benchmark tasks. In this paper, inspired by the recent success of automated machine learning (AutoML), we search bilinear scoring functions for different KG tasks through the AutoML techniques. However, it is non trivial to explore domain specific information here. We first set up a search space for AutoBLM by analyzing existing scoring functions. Then, we propose a progressive algorithm (AutoBLM) and an evolutionary algorithm (AutoBLM ), which are further accelerated by filter and predictor to deal with the domain specific properties for KG learning. Finally, we perform extensive experiments on benchmarks in KG completion, multi hop query, and entity classification tasks. Empirical results show that the searched scoring functions are KG dependent, new to the literature, and outperform the existing scoring functions. AutoBLM is better than AutoBLM as the evolutionary algorithm can flexibly explore better structures in the same budget.


Search Based Task Planning with Learned Skill Effect Models for Lifelong Robotic Manipulation. Robots deployed in many real world settings need to be able to acquire new skills and solve new tasks over time. Prior works on planning with skills often make assumptions on the structure of skills and tasks, such as subgoal skills, shared skill implementations, or task specific plan skeletons, which limit adaptation to new skills and tasks. By contrast, we propose doing task planning by jointly searching in the space of parameterized skills using high level skill effect models learned in simulation. We use an iterative training procedure to efficiently generate relevant data to train such models. Our approach allows flexible skill parameterizations and task specifications to facilitate lifelong learning in general purpose domains. Experiments demonstrate the ability of our planner to integrate new skills in a lifelong manner, finding new task strategies with lower costs in both train and test tasks. We additionally show that our method can transfer to the real world without further fine tuning.


Stability of bakeable capacitance diaphragm gauges. Here, we study the stability of capacitance diaphragm gauges. We focus on their stability before and after a controlled series of bakes. We find that baking results in appreciable shifts of the zero offset, but note that these can easily be corrected at time of use. Linearity however cannor be corrected at time of use, so it is essential to understand its effect if one wished to use similar gauges in a system that requires baking. For the gauges in this study, we find that baking introduces a minimal additional uncertainty, and that the total uncertainty can be kept to below about 0.3 at the k 2 confidence level (95 ).


Linguistic Knowledge in Data Augmentation for Natural Language Processing An Example on Chinese Question Matching. To investigate the role of linguistic knowledge in data augmentation (DA) for Natural Language Processing (NLP), particularly, whether more linguistic knowledge leads to a better DA approach, we designed two adapted DA programs and applied them to LCQMC (a Large scale Chinese Question Matching Corpus) for a binary Chinese question matching classification task. The two DA programs produce augmented texts by five simple text editing operations (or DA techniques), largely irrespective of language generation rules, but one is enhanced with a pre trained n gram language model to fuse it with prior linguistic knowledge. We then trained four neural network models (BOW, CNN, LSTM RNN, and GRU RNN) and a pre trained model (ERNIE Gram) on the LCQMC train sets of varying size as well as the related augmented train sets produced by the two DA programs. The test set performances of the five classification models show that adding probabilistic linguistic knowledge as constrains does not make the base DA program better, since there are no significant performance differences between the models trained on the two types of augmented train sets, both when the five DA techniques are applied together or separately. Moreover, due to the inability of the five DA techniques to make strictly paraphrastic augmented texts, the results indicate the need of sufficient amounts of training examples for the classification models trained on them to mediate the negative impact of false matching augmented text pairs and improve performances, a limitation of random text editing perturbations used a DA approach.


Stable Volumes for Persistent Homology. This paper proposes a stable volume and a stable volume variant, referred to as a stable sub volume, for more reliable data analysis using persistent homology. In prior research, an optimal cycle and similar ideas have been proposed to identify the homological structure corresponding to each birth death pair in a persistence diagram. While this is helpful for data analysis using persistent homology, the results are sensitive to noise. In this paper, stable volumes and stable sub volumes are proposed to solve this problem. For a special case, we prove that a stable volume is the robust part of an optimal volume against noise. We implemented stable volumes and sub volumes on HomCloud, a data analysis software package based on persistent homology, and show examples of stable volumes and sub volumes.


Transformers to Fight the COVID 19 Infodemic. The massive spread of false information on social media has become a global risk especially in a global pandemic situation like COVID 19. False information detection has thus become a surging research topic in recent months. NLP4IF 2021 shared task on fighting the COVID 19 infodemic has been organised to strengthen the research in false information detection where the participants are asked to predict seven different binary labels regarding false information in a tweet. The shared task has been organised in three languages Arabic, Bulgarian and English. In this paper, we present our approach to tackle the task objective using transformers. Overall, our approach achieves a 0.707 mean F1 score in Arabic, 0.578 mean F1 score in Bulgarian and 0.864 mean F1 score in English ranking 4th place in all the languages.


SRB measures for Anosov actions. Given a general Anosov R kappa action on a closed manifold, we study properties of certain invariant measures that have recently been introduced in cite BGHW20 using the theory of Ruelle Taylor resonances. We show that these measures share many properties of Sinai Ruelle Bowen measures for general Anosov flows such as smooth disintegrations along the unstable foliation, positive Lebesgue measure basins of attraction and a Bowen formula in terms of periodic orbits. Finally we show that if the action in the positive Weyl chamber is transitive, the measure is unique and has full support.


Fluctuating ecological networks a synthesis of maximum entropy approaches for pattern detection and process inference. Ecological networks such as plant pollinator systems and food webs vary in space and time. This variability includes fluctuations in global network properties such as total number and intensity of interactions but also in the local properties of individual nodes such as the number and intensity of species level interactions. Fluctuations of species properties can significantly affect higher order network features, e.g. robustness and nestedness. Local fluctuations should therefore be controlled for in applications that rely on null models, especially pattern and perturbation detection. By contrast, most randomization methods for null models used by ecologists treat node level local properties as hard constraints that cannot fluctuate. Here, we synthesise a set of methods that resolves the limit of hard constraints and is based on statistical mechanics. We illustrate the methods with some practical examples making available open source computer codes. We clarify how this approach can be used by experimental ecologists to detect non random network patterns with null models that not only rewire but also redistribute interaction strengths by allowing fluctuations in the null model constraints (soft constraints). Null modelling of species heterogeneity through local fluctuations around typical topological and quantitative constraints offers a statistically robust and expanded (e.g. quantitative null models) set of tools to understand the assembly and resilience of ecological networks.


Normal forms of parabolic logarithmic transseries. We give formal normal forms for parabolic logarithmic transseries f z cdots , , with respect to parabolic logarithmic normalizations. Normalizations are given algorithmically, using fixed point theorems, as limits of Picard's sequences in appropriate complete metric spaces, in contrast to transfinite emph term by term eliminations described in former works. Furthermore, we give the explicit formula for the residual coefficient in the normal form and show that, in the larger logarithmic class, we can even eliminate the residual term from the normal form.


A note on inverse results of random walks in Abelian groups. In this short note we give various near optimal characterizations of random walks over finite Abelian groups with large maximum discrepancy from the uniform measure. We also provide several interesting connections to existing results in the literature.


How Life Works Darwinian Evolution of Proteins. We review the development of thermodynamic protein hydropathic scaling theory, starting from backgrounds in mathematics and statistical mechanics, and leading to biomedical applications. Darwinian evolution has organized each protein family in different ways, but dynamical hydropathic scaling theory is both simple and effective in providing readily transferable dynamical insights for many proteins represented in the uncounted amino acid sequences, as well as the 90 thousand static structures contained in the online Protein Data Base. Critical point theory is general, and recently it has proved to be the most effective way of describing protein networks that have evolved towards nearly perfect functionality in given environments, self organized criticality. Darwinian evolutionary patterns are governed by common dynamical hydropathic scaling principles, which can be quantified using scales that have been developed bioinformatically by studying thousands of static PDB structures. The most effective dynamical scales involve hydropathic globular sculpting interactions averaged over length scales centered on domain dimensions. A central feature of dynamical hydropathic scaling theory is the characteristic domain length associated with a given protein functionality. Evolution has functioned in such a way that the minimal critical length scale established so far is about nine amino acids, but in some cases it is much larger. Some ingenuity is needed to find this primary length scale, as shown by the examples discussed here. Often a survey of the Darwinian evolution of a protein sequence suggests a means of determining the critical length scale. The evolution of Coronavirus is an interesting application it identifies critical mutations.


Best Privacy Practice Recommendations for Global Audio Streaming Platforms. Spoon Radio is a rapidly growing global audio streaming platform which currently operates in South Korea, the United States, Japan as well as the Middle East and North Africa. The platform believes that its commitment to user privacy is an important competitive factor. As such, it aims to not just comply with existing privacy regulations in regions where it operates today but to also ensure that it anticipates likely evolution to these regulations and of user expectations. In doing so, Spoon Radio wants to ensure it is well prepared to continue its expansion into new markets. As part of an effort to inform the evolution of its data practices, Spoon Radio reached out to the Privacy Engineering Program at CMU and sponsored a capstone project in which two master's students in the Program worked with Spoon Radio personnel over the course of the 2021 Fall Semester. The present report summarizes best practice recommendations that have emerged from this collaboration. These best practices are a combination of practices that are already implemented or in the process of being implemented by Spoon Radio today as well as more aspirational recommendations, which are expected to help inform Spoon Radio's practices in the future. In this report, best practice recommendations are organized around four stages of the data life cycle data collection, data storage, data usage, and finally data destruction. A separate section is devoted to content moderation, an area where platforms such as Spoon Radio need to reconcile considerations such as promoting freedom of expression with the need to create a safe and respectful environment that complies with applicable laws and respects relevant cultural values.


Patch NetVLAD Multi Scale Fusion of Locally Global Descriptors for Place Recognition. Visual Place Recognition is a challenging task for robotics and autonomous systems, which must deal with the twin problems of appearance and viewpoint change in an always changing world. This paper introduces Patch NetVLAD, which provides a novel formulation for combining the advantages of both local and global descriptor methods by deriving patch level features from NetVLAD residuals. Unlike the fixed spatial neighborhood regime of existing local keypoint features, our method enables aggregation and matching of deep learned local features defined over the feature space grid. We further introduce a multi scale fusion of patch features that have complementary scales (i.e. patch sizes) via an integral feature space and show that the fused features are highly invariant to both condition (season, structure, and illumination) and viewpoint (translation and rotation) changes. Patch NetVLAD outperforms both global and local feature descriptor based methods with comparable compute, achieving state of the art visual place recognition results on a range of challenging real world datasets, including winning the Facebook Mapillary Visual Place Recognition Challenge at ECCV2020. It is also adaptable to user requirements, with a speed optimised version operating over an order of magnitude faster than the state of the art. By combining superior performance with improved computational efficiency in a configurable framework, Patch NetVLAD is well suited to enhance both stand alone place recognition capabilities and the overall performance of SLAM systems.


Language Semantics Interpretation with an Interaction based Recurrent Neural Networks. Text classification is a fundamental language task in Natural Language Processing. A variety of sequential models is capable making good predictions yet there is lack of connection between language semantics and prediction results. This paper proposes a novel influence score (I score), a greedy search algorithm called Backward Dropping Algorithm (BDA), and a novel feature engineering technique called the "dagger technique". First, the paper proposes a novel influence score (I score) to detect and search for the important language semantics in text document that are useful for making good prediction in text classification tasks. Next, a greedy search algorithm called the Backward Dropping Algorithm is proposed to handle long term dependencies in the dataset. Moreover, the paper proposes a novel engineering technique called the "dagger technique" that fully preserve the relationship between explanatory variable and response variable. The proposed techniques can be further generalized into any feed forward Artificial Neural Networks (ANNs) and Convolutional Neural Networks (CNNs), and any neural network. A real world application on the Internet Movie Database (IMDB) is used and the proposed methods are applied to improve prediction performance with an 81 error reduction comparing with other popular peers if I score and "dagger technique" are not implemented.


MAVE A Product Dataset for Multi source Attribute Value Extraction. Attribute value extraction refers to the task of identifying values of an attribute of interest from product information. Product attribute values are essential in many e commerce scenarios, such as customer service robots, product ranking, retrieval and recommendations. While in the real world, the attribute values of a product are usually incomplete and vary over time, which greatly hinders the practical applications. In this paper, we introduce MAVE, a new dataset to better facilitate research on product attribute value extraction. MAVE is composed of a curated set of 2.2 million products from Amazon pages, with 3 million attribute value annotations across 1257 unique categories. MAVE has four main and unique advantages First, MAVE is the largest product attribute value extraction dataset by the number of attribute value examples. Second, MAVE includes multi source representations from the product, which captures the full product information with high attribute coverage. Third, MAVE represents a more diverse set of attributes and values relative to what previous datasets cover. Lastly, MAVE provides a very challenging zero shot test set, as we empirically illustrate in the experiments. We further propose a novel approach that effectively extracts the attribute value from the multi source product information. We conduct extensive experiments with several baselines and show that MAVE is an effective dataset for attribute value extraction task. It is also a very challenging task on zero shot attribute extraction. Data is available at it url https github.com google research datasets MAVE .


Solving equations in the symmetric group. We investigate the solutions of the conjugate equations aya ( 1) y 2 and aya ( 1) y ( 2) in the symmetric group S n . Here a is a fixed (constant) and y is a single unknown permutation (in S n ). It turns out that the existence of a non trivial solution y heavily depends on the type of a.


An ultralow noise superconducting radio frequency ion trap for frequency metrology with highly charged ions. We present a novel ultrastable superconducting radio frequency (RF) ion trap realized as a combination of an RF cavity and a linear Paul trap. Its RF quadrupole mode at 34.52 MHz reaches a quality factor of Q approx2.3 times 10 5 at a temperature of 4.1 K and is used to radially confine ions in an ultralow noise pseudopotential. This concept is expected to strongly suppress motional heating rates and related frequency shifts which limit the ultimate accuracy achieved in advanced ion traps for frequency metrology. Running with its low vibration cryogenic cooling system, electron beam ion trap and deceleration beamline supplying highly charged ions (HCI), the superconducting trap offers ideal conditions for optical frequency metrology with ionic species. We report its proof of principle operation as a quadrupole mass filter with HCI, and trapping of Doppler cooled 9 text Be Coulomb crystals.


Interaction of two high Reynolds number axisymmetric turbulent wakes. The interaction between turbulent axisymmetric wakes plays an important role in many industrial applications, notably in the modelling of wind farms. While the non equilibrium high Reynolds number scalings present in the wake of axisymmetric plates has been shown to modify the averaged streamwise scalings of individual wakes, little attention has been paid to their consequences in terms of wake interactions. We propose an experimental setup that tests the presence of non equilibrium turbulence using the streamwise variation of velocity fluctuations between two bluff bodies facing a laminar flow. We have studied two different sets of plates (one with regular and another with irregular peripheries) with hot wire anemometry in a wind tunnel. By acquiring streamwise profiles for different plate separations and identifying the wake interaction length for each separation it is possible to show that the interaction between them is consistent with non equilibrium scalings. This work also generalises previous studies concerned with the interaction of plane wakes to include axisymmetric wakes. We find that a simple mathematical expression for the wake interaction length based on non equilibrium turbulence scalings can be used to collapse the streamwise developments of the second, third and fourth moments of the streamwise fluctuating velocity.


Expanding photonic palette exploring high index materials. While the photonic community is being occupied with exotic concepts portending a grand future and fame if not a fortune, I respectfully entertain the possibility that a humble concept of simply increasing refractive index by a modest factor may have a far greater payoff in many walks of life. With that in mind, I explore why higher index materials have not yet materialized, and point out a few tentative directions for the search of these elusive materials, be they natural or artificial.


Free Breathing Myocardial T1 Mapping using Inversion Recovery Radial FLASH and Motion Resolved Model Based Reconstruction. Purpose To develop a free breathing myocardial T1 mapping technique using free running inversion recovery (IR) radial fast low angle shot (FLASH) and calibrationless motion resolved model based reconstruction. Methods A free running inversion recovery radial FLASH sequence is used for data acquisition at 3T. To reduce the waiting time between inversions, an analytical formula is derived that takes the incomplete T1 recovery into account for an accurate T1 calculation. The respiratory motion signal is estimated from the filtered k space center using an adapted singular spectrum analysis (SSA FARY) technique. The cardiac motion signal is recorded using electrocardiography. A motion resolved model based reconstruction is used to estimate both parameter and coil sensitivity maps directly from the sorted k space data. Spatial temporal total variation, in addition to the spatial sparsity constraints, is applied to the parameter maps to improve T1 accuracy and precision. Validations are performed on an experimental phantom and five human subjects. Results In comparison to an IR spin echo reference, phantom results confirm good T1 accuracy when reducing the waiting time from five seconds to one second using the new correction. The motion resolved model based reconstruction further improves T1 precision. Aside from showing that a reliable respiratory motion signal can be estimated using modified SSA FARY, in vivo studies with five healthy subjects demonstrate that high resolution dynamic myocardial T1 maps (1.0x1.0x6 mm 3 )can be obtained within two minutes with good T1 precision and repeatability. Conclusion High resolution motion resolved T1 mapping during free breathing with good T1 accuracy, precision, and repeatability can be achieved by combining inversion recovery radial FLASH, self gating, and a calibrationless motion resolved model based reconstruction.


Knowledgeable Prompt tuning Incorporating Knowledge into Prompt Verbalizer for Text Classification. Tuning pre trained language models (PLMs) with task specific prompts has been a promising approach for text classification. Particularly, previous studies suggest that prompt tuning has remarkable superiority in the low data scenario over the generic fine tuning methods with extra classifiers. The core idea of prompt tuning is to insert text pieces, i.e., template, to the input and transform a classification problem into a masked language modeling problem, where a crucial step is to construct a projection, i.e., verbalizer, between a label space and a label word space. A verbalizer is usually handcrafted or searched by gradient descent, which may lack coverage and bring considerable bias and high variances to the results. In this work, we focus on incorporating external knowledge into the verbalizer, forming a knowledgeable prompt tuning (KPT), to improve and stabilize prompt tuning. Specifically, we expand the label word space of the verbalizer using external knowledge bases (KBs) and refine the expanded label word space with the PLM itself before predicting with the expanded label word space. Extensive experiments on zero and few shot text classification tasks demonstrate the effectiveness of knowledgeable prompt tuning.


Attacking Video Recognition Models with Bullet Screen Comments. Recent research has demonstrated that Deep Neural Networks (DNNs) are vulnerable to adversarial patches which introduce perceptible but localized changes to the input. Nevertheless, existing approaches have focused on generating adversarial patches on images, their counterparts in videos have been less explored. Compared with images, attacking videos is much more challenging as it needs to consider not only spatial cues but also temporal cues. To close this gap, we introduce a novel adversarial attack in this paper, the bullet screen comment (BSC) attack, which attacks video recognition models with BSCs. Specifically, adversarial BSCs are generated with a Reinforcement Learning (RL) framework, where the environment is set as the target model and the agent plays the role of selecting the position and transparency of each BSC. By continuously querying the target models and receiving feedback, the agent gradually adjusts its selection strategies in order to achieve a high fooling rate with non overlapping BSCs. As BSCs can be regarded as a kind of meaningful patch, adding it to a clean video will not affect people' s understanding of the video content, nor will arouse people' s suspicion. We conduct extensive experiments to verify the effectiveness of the proposed method. On both UCF 101 and HMDB 51 datasets, our BSC attack method can achieve about 90 fooling rate when attacking three mainstream video recognition models, while only occluding textless 8 areas in the video. Our code is available at https github.com kay ck BSC attack.


A Discrete Variational Derivation of Accelerated Methods in Optimization. Many of the new developments in machine learning are connected with gradient based optimization methods. Recently, these methods have been studied using a variational perspective. This has opened up the possibility of introducing variational and symplectic methods using geometric integration. In particular, in this paper, we introduce variational integrators which allow us to derive different methods for optimization. Using both, Hamilton's and Lagrange d'Alembert's principle, we derive two families of respective optimization methods in one to one correspondence that generalize Polyak's heavy ball and the well known Nesterov accelerated gradient method, the second of which mimics the behavior of the first reducing the oscillations of classical momentum methods. However, since the systems considered are explicitly time dependent, the preservation of symplecticity of autonomous systems occurs here solely on the fibers. Several experiments exemplify the result.


Assessing the embodied carbon footprint of IoT edge devices with a bottom up life cycle approach. In upcoming years, the number of Internet of Things (IoT) devices is expected to surge up to tens of billions of physical objects. However, while the IoT is often presented as a promising solution to tackle environmental challenges, the direct environmental impacts generated over the life cycle of the physical devices are usually overlooked. It is implicitly assumed that their environmental burden is negligible compared to the positive impacts they can generate. In this paper, we present a parametric framework based on hardware profiles to evaluate the cradle to gate carbon footprint of IoT edge devices. We exploit our framework in three ways. First, we apply it on four use cases to evaluate their respective production carbon footprint. Then, we show that the heterogeneity inherent to IoT edge devices must be considered as the production carbon footprint between simple and complex devices can vary by a factor of more than 150x. Finally, we estimate the absolute carbon footprint induced by the worldwide production of IoT edge devices through a macroscopic analysis over a 10 year period. Results range from 22 to 562 MtCO2 eq year in 2027 depending on the deployment scenarios. However, the truncation error acknowledged for LCA bottom up approaches usually lead to an undershoot of the environmental impacts. We compared the results of our use cases with the few reports available from Google and Apple, which suggest that our estimates could be revised upwards by a factor around 2x to compensate for the truncation error. Worst case scenarios in 2027 would therefore reach more than 1000 MtCO2 eq year. This truly stresses the necessity to consider environmental constraints when designing and deploying IoT edge devices.


Multidimensional linear and nonlinear partial integro differential equation in Bessel potential spaces with applications in option pricing. The purpose of this paper is to analyze solutions of a non local nonlinear partial integro differential equation (PIDE) in multidimensional spaces. Such class of PIDE often arises in financial modeling. We employ the theory of abstract semilinear parabolic equations in order to prove existence and uniqueness of solutions in the scale of Bessel potential spaces. We consider a wide class of L 'evy measures satisfying suitable growth conditions near the origin and infinity. The novelty of the paper is the generalization of already known results in the one space dimension to the multidimensional case. We consider Black Scholes models for option pricing on underlying assets following a L 'evy stochastic process with jumps. As an application to option pricing in the one dimensional space, we consider a general shift function arising from nonlinear option pricing models taking into account a large trader stock trading strategy. We prove existence and uniqueness of a solution to the nonlinear PIDE in which the shift function may depend on a prescribed large investor stock trading strategy function.


Learning to See by Looking at Noise. Current vision systems are trained on huge datasets, and these datasets come with costs curation is expensive, they inherit human biases, and there are concerns over privacy and usage rights. To counter these costs, interest has surged in learning from cheaper data sources, such as unlabeled images. In this paper we go a step further and ask if we can do away with real image datasets entirely, instead learning from noise processes. We investigate a suite of image generation models that produce images from simple random processes. These are then used as training data for a visual representation learner with a contrastive loss. We study two types of noise processes, statistical image models and deep generative models under different random initializations. Our findings show that it is important for the noise to capture certain structural properties of real data but that good performance can be achieved even with processes that are far from realistic. We also find that diversity is a key property to learn good representations. Datasets, models, and code are available at https mbaradad.github.io learning with noise.


On the average order of a dominating set of a forest. We show that the average order of a dominating set of a forest graph G on n vertices with no isolated vertices is at most 2n 3 . Moreover, the equality is achieved if and only if every non leaf vertex of G is a support vertex with one or two leaf neighbors. Our result answers an open question of Beaton and Brown.


On the Potential of Fourier Encoded Saturation Transfers for Sensitizing Solid State Magic Angle Spinning NMR Experiments. Chemical exchange saturation transfer (CEST) is widely used for enhancing the solution NMR signatures of magnetically dilute spin pools in particular species at low concentrations undergoing chemical exchanges with an abundant spin pool. CEST's main feature involves encoding and then detecting the weak NMR signals of the magnetically dilute spin pools on a magnetically abundant spin pool of much easier detection for instance the protons of H2O. Inspired by this method, we propose and exemplify a methodology to enhance the sensitivity of magic angle spinning (MAS) solid state NMR spectra. Our proposal uses the abundant 1H reservoir arising in organic solids as the magnetically abundant spin pool, and relies on proton spin diffusion in lieu of chemical exchange to mediate polarization transfer between a magnetically dilute spin pool and this magnetically abundant spin reporter. As an initial test of this idea we target the spectroscopy of naturally abundant 13C, and rely on a Fourier encoded version of the CEST experiment for achieving broadbandness in coordination with both MAS and heteronuclear decoupling features normally absent in CEST. Arbitrary evolutions of multiple 13C sites can thus be imprinted on the entire 1H reservoir, which is subsequently detected. Theoretical predictions suggest that orders of magnitude signal enhancements should be achievable in this manner on the order of the ratio between the 13C and the 1H reservoirs' abundances. Experiments carried out under magic angle spinning conditions evidenced ca. 5 10x enhancements. Further opportunities and challenges arising in this Fourier Encoded Saturation Transfer (FEST) MAS NMR approach are briefly discussed.


Poincar 'e Duality for Hopf algebroids. We prove a twisted Poincar 'e duality for (full) Hopf algebroids with bijective antipode. As an application, we recover the Hochschild twisted Poincar 'e duality of Van Den Bergh VDB . We also get a Poisson twisted Poincar 'e duality, which was already stated for oriented Poisson manifolds in CLYZ .


Enhancing Model Robustness and Fairness with Causality A Regularization Approach. Recent work has raised concerns on the risk of spurious correlations and unintended biases in statistical machine learning models that threaten model robustness and fairness. In this paper, we propose a simple and intuitive regularization approach to integrate causal knowledge during model training and build a robust and fair model by emphasizing causal features and de emphasizing spurious features. Specifically, we first manually identify causal and spurious features with principles inspired from the counterfactual framework of causal inference. Then, we propose a regularization approach to penalize causal and spurious features separately. By adjusting the strength of the penalty for each type of feature, we build a predictive model that relies more on causal features and less on non causal features. We conduct experiments to evaluate model robustness and fairness on three datasets with multiple metrics. Empirical results show that the new models built with causal awareness significantly improve model robustness with respect to counterfactual texts and model fairness with respect to sensitive attributes.


The Calder ' o n inverse problem for isotropic quasilinear conductivities. We prove a global uniqueness result for the Calder ' o n inverse problem for a general quasilinear isotropic conductivity equation on a bounded open set with smooth boundary in dimension n ge 3 . Performing higher order linearizations of the nonlinear Dirichlet to Neumann map, we reduce the problem of the recovery of the differentials of the quasilinear conductivity, which are symmetric tensors, to a completeness property for certain anisotropic products of solutions to the linearized equation. The completeness property is established using complex geometric optics solutions to the linearized conductivity equation, whose amplitudes concentrate near suitable two dimensional planes.


Generation of analytic semigroup for some generalized diffusion operators in Lp spaces. We consider five different abstract Cauchy problems where the operator is of fourth order. For each problem, using semigroups techniques and functional calculus, we study the invertibility and the spectral properties of the fourth order operator to show that it generates an analytic semigroup.


Parameterized codes over graphs. In this article we review known results on parameterized linear codes over graphs, introduced by Renter 'ia, Simis and Villarreal in 2011. Very little is known about their basic parameters and invariants. We review in detail the parameters dimension, regularity and minimum distance. As regards the parameter dimension, we explore the connection to Eulerian ideals in the ternary case and we give new combinatorial formulas.


Near wall turbulence modulation by small inertial particles. We use interface resolved simulations to study near wall turbulence modulation by small inertial particles, much denser than the fluid, in dilute semi dilute conditions. We considered three bulk solid mass fractions, Psi 0.34 , 3.37 and 33.7 , with only the latter two showing turbulence modulation. The increase of the drag is strong at Psi 3.37 , but mild in the densest case. Actually, two distinct regimes of turbulence modulation emerge for smaller mass fractions, the turbulence statistics are weakly affected and the near wall particle accumulation increases the drag so the flow appears as a single phase flow at slightly higher Reynolds number. Conversely, at higher mass fractions, the particles modulate the turbulent dynamics over the entire flow, and the interphase coupling becomes more complex. In this case, fluid Reynolds stresses are attenuated, but the inertial particle dynamics increases the drag via correlated velocity fluctuations leading to an overall drag increase. Hence, we conclude that, although particles at high mass fractions reduce the fluid turbulent drag, the solid phase inertial dynamics may still increase the overall drag. However, inspection of the streamwise momentum budget in the two way coupling limit of vanishing volume fraction, but finite mass fraction, indicates that this trend could reverse at even higher particle load.


Body Meshes as Points. We consider the challenging multi person 3D body mesh estimation task in this work. Existing methods are mostly two stage based one stage for person localization and the other stage for individual body mesh estimation, leading to redundant pipelines with high computation cost and degraded performance for complex scenes (e.g., occluded person instances). In this work, we present a single stage model, Body Meshes as Points (BMP), to simplify the pipeline and lift both efficiency and performance. In particular, BMP adopts a new method that represents multiple person instances as points in the spatial depth space where each point is associated with one body mesh. Hinging on such representations, BMP can directly predict body meshes for multiple persons in a single stage by concurrently localizing person instance points and estimating the corresponding body meshes. To better reason about depth ordering of all the persons within the same scene, BMP designs a simple yet effective inter instance ordinal depth loss to obtain depth coherent body mesh estimation. BMP also introduces a novel keypoint aware augmentation to enhance model robustness to occluded person instances. Comprehensive experiments on benchmarks Panoptic, MuPoTS 3D and 3DPW clearly demonstrate the state of the art efficiency of BMP for multi person body mesh estimation, together with outstanding accuracy. Code can be found at https github.com jfzhang95 BMP.


SaRoCo Detecting Satire in a Novel Romanian Corpus of News Articles. In this work, we introduce a corpus for satire detection in Romanian news. We gathered 55,608 public news articles from multiple real and satirical news sources, composing one of the largest corpora for satire detection regardless of language and the only one for the Romanian language. We provide an official split of the text samples, such that training news articles belong to different sources than test news articles, thus ensuring that models do not achieve high performance simply due to overfitting. We conduct experiments with two state of the art deep neural models, resulting in a set of strong baselines for our novel corpus. Our results show that the machine level accuracy for satire detection in Romanian is quite low (under 73 on the test set) compared to the human level accuracy (87 ), leaving enough room for improvement in future research.


Computing the Probability of a Financial Market Failure A New Measure of Systemic Risk. This paper characterizes the probability of a market failure defined as the default of two or more globally systemically important banks (G SIBs) in a small interval of time. The default probabilities of the G SIBs are correlated through the possible existence of a market wide stress event. The characterization employs a multivariate Cox process across the G SIBs, which allows us to relate our work to the existing literature on intensity based models. Various theorems related to market failure probabilities are derived, including the probability of a market failure due to two banks defaulting over the next infinitesimal interval, the probability of a catastrophic market failure, the impact of increasing the number of G SIBs in an economy, and the impact of changing the initial conditions of the economy's state variables. We also show that if there are too many G SIBs, a market failure is inevitable, i.e., the probability of a market failure tends to 1.


Global exact controllability of ideal incompressible magnetohydrodynamic flows through a planar duct. This article is concerned with the global exact controllability for ideal incompressible magnetohydrodynamics in a rectangular domain where the controls are situated in both vertical walls. First, global exact controllability via boundary controls is established for a related Els "asser type system by applying the return method, introduced in Coron J.M., Math. Control Signals Systems, 5(3) (1992) 295 312 . Similar results are then inferred for the original magnetohydrodynamics system with the help of a special pressure like corrector in the induction equation. Overall, the main difficulties stem from the nonlinear coupling between the fluid velocity and the magnetic field in combination with the aim of exactly controlling the system. In order to overcome some of the obstacles, we introduce ad hoc constructions, such as suitable initial data extensions outside of the physical part of the domain and a certain weighted space.


Improving Portuguese Semantic Role Labeling with Transformers and Transfer Learning. The Natural Language Processing task of determining "Who did what to whom" is called Semantic Role Labeling. For English, recent methods based on Transformer models have allowed for major improvements in this task over the previous state of the art. However, for low resource languages, like Portuguese, currently available semantic role labeling models are hindered by scarce training data. In this paper, we explore a model architecture with only a pre trained Transformer based model, a linear layer, softmax and Viterbi decoding. We substantially improve the state of the art performance in Portuguese by over 15 F1. Additionally, we improve semantic role labeling results in Portuguese corpora by exploiting cross lingual transfer learning using multilingual pre trained models, and transfer learning from dependency parsing in Portuguese, evaluating the various proposed approaches empirically.


Orbital stability of internal waves. This paper studies the nonlinear stability of capillary gravity waves propagating along the interface dividing two immiscible fluid layers of finite depth. The motion in both regions is governed by the incompressible and irrotational Euler equations, with the density of each fluid being constant but distinct. A diverse collection of small amplitude solitary wave solutions for this system have been constructed by several authors in the case of strong surface tension (as measured by the Bond number) and slightly subcritical Froude number. We prove that all of these waves are (conditionally) orbitally stable in the natural energy space. Moreover, the trivial solution is shown to be conditionally stable when the Bond and Froude numbers lie in a certain unbounded parameter region. For the near critical surface tension regime, we prove that one can infer conditional orbital stability or orbital instability of small amplitude traveling waves solutions to the full Euler system from considerations of a dispersive PDE model equation. These results are obtained by reformulating the problem as an infinite dimensional Hamiltonian system, then applying a version of the Grillakis Shatah Strauss method recently introduced by Varholm, Wahl 'en, and Walsh. A key part of the analysis consists of computing the spectrum of the linearized augmented Hamiltonian at a shear flow or small amplitude wave. For this, we generalize an idea used by Mielke to treat capillary gravity water waves beneath vacuum.


FPB Feature Pyramid Branch for Person Re Identification. High performance person Re Identification (Re ID) requires the model to focus on both global silhouette and local details of pedestrian. To extract such more representative features, an effective way is to exploit deep models with multiple branches. However, most multi branch based methods implemented by duplication of part backbone structure normally lead to severe increase of computational cost. In this paper, we propose a lightweight Feature Pyramid Branch (FPB) to extract features from different layers of networks and aggregate them in a bidirectional pyramid structure. Cooperated by attention modules and our proposed cross orthogonality regularization, FPB significantly prompts the performance of backbone network by only introducing less than 1.5M extra parameters. Extensive experimental results on standard benchmark datasets demonstrate that our proposed FPB based model outperforms state of the art methods with obvious margin as well as much less model complexity. FPB borrows the idea of the Feature Pyramid Network (FPN) from prevailing object detection methods. To our best knowledge, it is the first successful application of similar structure in person Re ID tasks, which empirically proves that pyramid network as affiliated branch could be a potential structure in related feature embedding models. The source code is publicly available at https github.com anocodetest1 FPB.git.


Stability and bifurcations of symmetric tops. We study the stability and bifurcation of relative equilibria of a particle on the Lie group SO(3) whose motion is governed by an SO(3) times SO(2) invariant metric and an SO(2) times SO(2) invariant potential. Our method is to reduce the number of degrees of freedom at singular values of the SO(2) times SO(2) momentum map and study the stability of the equilibria of the reduced systems as a function of spin. The result is an elementary analysis of the fast slow transition in the Lagrange and Kirchhoff tops. More generally, since an SO(2) times SO(2) invariant potential on SO(3) can be thought of as mathbb Z 2 invariant function on a circle, we analyze the stability and bifurcation of relative equilibria of the system in terms of the second and fourth derivative of the function.


Evaluating the Robustness of Neural Language Models to Input Perturbations. High performance neural language models have obtained state of the art results on a wide range of Natural Language Processing (NLP) tasks. However, results for common benchmark datasets often do not reflect model reliability and robustness when applied to noisy, real world data. In this study, we design and implement various types of character level and word level perturbation methods to simulate realistic scenarios in which input texts may be slightly noisy or different from the data distribution on which NLP systems were trained. Conducting comprehensive experiments on different NLP tasks, we investigate the ability of high performance language models such as BERT, XLNet, RoBERTa, and ELMo in handling different types of input perturbations. The results suggest that language models are sensitive to input perturbations and their performance can decrease even when small changes are introduced. We highlight that models need to be further improved and that current benchmarks are not reflecting model robustness well. We argue that evaluations on perturbed inputs should routinely complement widely used benchmarks in order to yield a more realistic understanding of NLP systems robustness.


An enriched category theory of language from syntax to semantics. State of the art language models return a natural language text continuation from any piece of input text. This ability to generate coherent text extensions implies significant sophistication, including a knowledge of grammar and semantics. In this paper, we propose a mathematical framework for passing from probability distributions on extensions of given texts, such as the ones learned by today's large language models, to an enriched category containing semantic information. Roughly speaking, we model probability distributions on texts as a category enriched over the unit interval. Objects of this category are expressions in language, and hom objects are conditional probabilities that one expression is an extension of another. This category is syntactical it describes what goes with what. Then, via the Yoneda embedding, we pass to the enriched category of unit interval valued copresheaves on this syntactical category. This category of enriched copresheaves is semantic it is where we find meaning, logical operations such as entailment, and the building blocks for more elaborate semantic concepts.


Investigation of Dataset Features for Just in Time Defect Prediction. Just in time (JIT) defect prediction refers to the technique of predicting whether a code change is defective. Many contributions have been made in this area through the excellent dataset by Kamei. In this paper, we revisit the dataset and highlight preprocessing difficulties with the dataset and the limitations of the dataset on unsupervised learning. Secondly, we propose certain features in the Kamei dataset that can be used for training models. Lastly, we discuss the limitations of the dataset's features.


The Possibilistic Horn Non Clausal Knowledge Bases. Posibilistic logic is the most extended approach to handle uncertain and partially inconsistent information. Regarding normal forms, advances in possibilistic reasoning are mostly focused on clausal form. Yet, the encoding of real world problems usually results in a non clausal (NC) formula and NC to clausal translators produce severe drawbacks that heavily limit the practical performance of clausal reasoning. Thus, by computing formulas in its original NC form, we propose several contributions showing that notable advances are also possible in possibilistic non clausal reasoning. em Firstly, we define the class of em Possibilistic Horn Non Clausal Knowledge Bases, or mathcal overline H Sigma , which subsumes the classes possibilistic Horn and propositional Horn NC. mathcal overline H Sigma is shown to be a kind of NC analogous of the standard Horn class. em Secondly , we define em Possibilistic Non Clausal Unit Resolution, or mathcal UR Sigma , and prove that mathcal UR Sigma correctly computes the inconsistency degree of mathcal overline H Sigma members. mathcal UR Sigma had not been proposed before and is formulated in a clausal like manner, which eases its understanding, formal proofs and future extension towards non clausal resolution. em Thirdly , we prove that computing the inconsistency degree of mathcal overline H Sigma members takes polynomial time. Although there already exist tractable classes in possibilistic logic, all of them are clausal, and thus, mathcal overline H Sigma turns out to be the first characterized polynomial non clausal class within possibilistic reasoning.


The typical approximate structure of sets with bounded sumset. Let A 1 and A 2 be randomly chosen subsets of the first n integers of cardinalities s 2 geq s 1 Omega(s 2) , such that their sumset A 1 A 2 has size m . We show that asymptotically almost surely A 1 and A 2 are almost fully contained in arithmetic progressions P 1 and P 2 with the same common difference and cardinalities approximately s i m (s 1 s 2) . We also prove a counting theorem for such pairs of sets in arbitrary abelian groups. The results hold for s i omega( log 3 n) and s 1 s 2 leq m o(s 2 log 3 n) . Our main tool is an asymmetric version of the method of hypergraph containers which was recently used by Campos to prove similar results in the special case A B .


Global well posedness and inviscid limits of the generalized Oldroyd type models. We obtain the global small solutions to the generalized Oldroyd B model without damping on the stress tensor in mathbb R n . Our result give positive answers partially to the question proposed by Elgindi and Liu (Remark 2 in Elgindi and Liu J Differ Equ 259 1958 1966, 2015) . The proof relies heavily on the trick of transferring dissipation from u to tau , and a new commutator estimate which may be of interest for future works. Moreover, we prove a global result of inviscid limit of two dimensional Oldroyd type models in the Sobolev spaces. The convergence rate is also obtained simultaneously.


Birkhoff's Completeness Theorem for Multi Sorted Algebras Formalized in Agda. This document provides a formal proof of Birkhoff's completeness theorem for multi sorted algebras which states that any equational entailment valid in all models is also provable in the equational theory. More precisely, if a certain equation is valid in all models that validate a fixed set of equations, then this equation is derivable from that set using the proof rules for a congruence. The proof has been formalized in Agda version 2.6.2 with the Agda Standard Library version 1.7 and this document reproduces the commented Agda code.


A Probabilistic Approach to Personalize Type based Facet Ranking for POI Suggestion. Faceted Search Systems (FSS) have become one of the main search interfaces used in vertical search systems, offering users meaningful facets to refine their search query and narrow down the results quickly to find the intended search target. This work focuses on the problem of ranking type based facets. In a structured information space, type based facets (t facets) indicate the category to which each object belongs. When they belong to a large multi level taxonomy, it is desirable to rank them separately before ranking other facet groups. This helps the searcher in filtering the results according to their type first. This also makes it easier to rank the rest of the facets once the type of the intended search target is selected. Existing research employs the same ranking methods for different facet groups. In this research, we propose a two step approach to personalize t facet ranking. The first step assigns a relevance score to each individual leaf node t facet. The score is generated using probabilistic models and it reflects t facet relevance to the query and the user profile. In the second step, this score is used to re order and select the sub tree to present to the user. We investigate the usefulness of the proposed method to a Point Of Interest (POI) suggestion task. Our evaluation aims at capturing the user effort required to fulfil her search needs by using the ranked facets. The proposed approach achieved better results than other existing personalized baselines.


Existence of the stationary Navier Stokes flow in mathbb R 2 around a radial flow. We consider the stationary Navier Stokes equations on the whole plane mathbb R 2 . We show that for a given small and smooth external force around a radial flow, there exists a classical solution decaying like x 1 . In our result, it is not necessary to impose any symmetric conditions on external forces.


Modelling the Second Covid 19 Wave in Mumbai. India has been hit by a huge second wave of Covid 19 that started in mid February 2021. Mumbai was amongst the first cities to see the increase. In this report, we use our agent based simulator to computationally study the second wave in Mumbai. We build upon our earlier analysis, where projections were made from November 2020 onwards. We use our simulator to conduct an extensive scenario analysis we play out many plausible scenarios through varying economic activity, reinfection levels, population compliance, infectiveness, prevalence and lethality of the possible variant strains, and infection spread via local trains to arrive at those that may better explain the second wave fatality numbers. We observe and highlight that timings of peak and valley of the fatalities in the second wave are robust to many plausible scenarios, suggesting that they are likely to be accurate projections for Mumbai. During the second wave, the observed fatalities were low in February and mid March and saw a phase change or a steep increase in the growth rate after around late March. We conduct extensive experiments to replicate this observed sharp convexity. This is not an easy phenomena to replicate, and we find that explanations such as increased laxity in the population, increased reinfections, increased intensity of infections in Mumbai transportation, increased lethality in the virus, or a combination amongst them, generally do a poor job of matching this pattern. We find that the most likely explanation is presence of small amount of extremely infective variant on February 1 that grows rapidly thereafter and becomes a dominant strain by Mid March. From a prescriptive view, this points to an urgent need for extensive and continuous genome sequencing to establish existence and prevalence of different virus strains in Mumbai and in India, as they evolve over time.


Coining goldMEDAL A New Contribution to Data Lake Generic Metadata Modeling. The rise of big data has revolutionized data exploitation practices and led to the emergence of new concepts. Among them, data lakes have emerged as large heterogeneous data repositories that can be analyzed by various methods. An efficient data lake requires a metadata system that addresses the many problems arising when dealing with big data. In consequence, the study of data lake metadata models is currently an active research topic and many proposals have been made in this regard. However, existing metadata models are either tailored for a specific use case or insufficiently generic to manage different types of data lakes, including our previous model MEDAL. In this paper, we generalize MEDAL's concepts in a new metadata model called goldMEDAL. Moreover, we compare goldMEDAL with the most recent state of the art metadata models aiming at genericity and show that we can reproduce these metadata models with goldMEDAL's concepts. As a proof of concept, we also illustrate that goldMEDAL allows the design of various data lakes by presenting three different use cases.


ILoSA Interactive Learning of Stiffness and Attractors. Teaching robots how to apply forces according to our preferences is still an open challenge that has to be tackled from multiple engineering perspectives. This paper studies how to learn variable impedance policies where both the Cartesian stiffness and the attractor can be learned from human demonstrations and corrections with a user friendly interface. The presented framework, named ILoSA, uses Gaussian Processes for policy learning, identifying regions of uncertainty and allowing interactive corrections, stiffness modulation and active disturbance rejection. The experimental evaluation of the framework is carried out on a Franka Emika Panda in four separate cases with unique force interaction properties 1) pulling a plug wherein a sudden force discontinuity occurs upon successful removal of the plug, 2) pushing a box where a sustained force is required to keep the robot in motion, 3) wiping a whiteboard in which the force is applied perpendicular to the direction of movement, and 4) inserting a plug to verify the usability for precision critical tasks in an experimental validation performed with non expert users.


Big prime factors in orders of elliptic curves over finite fields. Let E be an elliptic curve over the finite field mathbb F q . We prove that, when n is a sufficiently large positive integer, E( mathbb F q n ) has a prime factor exceeding n exp(c log n log log n) .


Phase delays in omega 2 omega above threshold ionization. Relative phases of atomic above threshold ionization wavepackets have been investigated in a recent experiment L. J. Zipp, A. Natan, and P. H. Bucksbaum, Optica textbf 1 , 361 364 (2014) exploiting interferences between different pathways in a weak probe field at half the frequency of the strong ionization pulse. In this work we theoretically explore the extraction of phase delays and time delays of attosecond wavepackets formed in strong field ionization. We perform simulations solving the time dependent Schr "odinger equation and compare these results with the strong field and Coulomb Volkov approximations. In order to disentangle short from long ranged effects of the atomic potential we also perform simulations for atomic model potentials featuring a Yukawa type short range potential. We find significant deviations of the textit ab initio phase delays between different photoelectron pathways from the predictions by the strong field approximation even at energies well above the ionization threshold. We identify similarities but also profound differences to the well known interferometric extraction of phase and time delays in one photon ionization.


Modelling wave dispersion in fluid saturating periodic scaffolds. Acoustic waves in a slightly compressible fluid saturating porous periodic structure are studied using two complementary approaches 1) the periodic homogenization (PH) method provides effective model equations for a general dynamic problem imposed in a bounded medium, 2) harmonic acoustic waves are studied in an infinite medium using the Floquet Bloch (FB) wave decomposition. In contrast with usual simplifications, the advection phenomenon of the Navier Stokes equations is accounted for. For this, an acoustic approximation is applied to linearize the advection term. The homogenization results are based the periodic unfolding method combined with the asymptotic expansion technique providing a straight upscaling procedure which leads to the macroscopic model defined in terms of the effective model parameters. These are computed using the characteristic responses of the porous microstructure. Using the FB theory, we derive dispersion equations for the scaffolds saturated by the inviscid, or the viscous, barotropic fluids, whereby the advection due to a permanent flow in the porous structures is respected. A computational study is performed for the numerical models obtained using the finite element discretization. For the FB methods based dispersion analysis, quadratic eigenvalue problems must be solved. The numerical examples show influences of the microstructure size and of the advection generating an anisotropy of the acoustic waves dispersion.


Do Not Forget the Past A Buffer Aided Framework for Relay Based Key Generation. We address relay assisted key generation wherein two wireless nodes, that have no direct channel between them, seek the assistance of an intermediate relay to generate secret keys. In a celebrated version of the relay assisted protocol, as applied by Lai et al., Zhou et al., Wang et al. and Waqas et al., the relay node generates pair wise keys with the two nodes, and then broadcasts an XOR version of the two keys. Although such protocols are simple and effective, we observe that they face reduction in key rates due to two problems. First, for confidentiality, the relay broadcasts an XOR function of the pair wise keys thereby pruning the length of the shared key to be the minimum of the key lengths of the pair wise keys. Secondly, the broadcast phase may also experience outages thereby not being able to share the generated key in every round of the protocol. Identifying these issues, we propose a buffer aided relaying protocol wherein buffer is used at the relay to store unused secret bits generated in the previous rounds of the protocol so as to provide confidentiality in the subsequent rounds of broadcast. On this buffer aided protocol, we propose a power allocation strategy between the phases of key generation and broadcast so as to maximize the throughput and key rate. Rigorous analyses show that buffer aided relay when implemented along with the proposed power allocation strategy offer remarkable advantages over existing baselines.


Distinguishing infinite star free graphs. Call a colouring of a graph emph distinguishing if the only automorphism of this graph which preserves said colouring is the identity. Let H be an arbitrary graph. We say that a graph G is emph H free if G does not contain an induced subgraph isomorphic to H . Kargul, Musia l , Pal and Gorzkowska showed that if n is a natural number greater than two, then every finite connected K 1,n free graph of order at least six admits a distinguishing edge colouring with at most n 1 colours. We extend this result to all locally finite connected K 1,n free graphs of order at least six.


Online Graph Algorithms with Predictions. Online algorithms with predictions is a popular and elegant framework for bypassing pessimistic lower bounds in competitive analysis. In this model, online algorithms are supplied with future predictions, and the goal is for the competitive ratio to smoothly interpolate between the best offline and online bounds as a function of the prediction error. In this paper, we study online graph problems with predictions. Our contributions are the following The first question is defining prediction error. For graph metric problems, there can be two types of error, locations that are not predicted, and locations that are predicted but the predicted and actual locations do not coincide exactly. We design a novel definition of prediction error called metric error with outliers to simultaneously capture both types of errors, which thereby generalizes previous definitions of error that only capture one of the two error types. We give a general framework for obtaining online algorithms with predictions that combines, in a "black box" fashion, existing online and offline algorithms, under certain technical conditions. To the best of our knowledge, this is the first general purpose tool for obtaining online algorithms with predictions. Using our framework, we obtain tight bounds on the competitive ratio of several classical graph problems as a function of metric error with outliers Steiner tree, Steiner forest, priority Steiner tree forest, and uncapacitated capacitated facility location. Both the definition of metric error with outliers and the general framework for combining offline and online algorithms are not specific to the problems that we consider in this paper. We hope that these will be useful for future work in this domain.


Three Ways to Solve Partial Differential Equations with Neural Networks A Review. Neural networks are increasingly used to construct numerical solution methods for partial differential equations. In this expository review, we introduce and contrast three important recent approaches attractive in their simplicity and their suitability for high dimensional problems physics informed neural networks, methods based on the Feynman Kac formula and methods based on the solution of backward stochastic differential equations. The article is accompanied by a suite of expository software in the form of Jupyter notebooks in which each basic methodology is explained step by step, allowing for a quick assimilation and experimentation. An extensive bibliography summarizes the state of the art.


Cartan connections and path structures with large automorphism groups. We classify compact manifolds of dimension three equipped with a path structure and a fixed contact form (which we refer to as a strict path structure) under the hypothesis that their automorphism group is non compact. We use a Cartan connection associated to the structure and show that its curvature is constant.


Asynchronous Truncated Multigrid reduction in time (AT MGRIT). In this paper, we present the new "asynchronous truncated multigrid reduction in time" (AT MGRIT) algorithm for introducing time parallelism to the solution of discretized time dependent problems. The new algorithm is based on the multigrid reduction in time (MGRIT) approach, which, in certain settings, is equivalent to another common multilevel parallel in time method, Parareal. In contrast to Parareal and MGRIT that both consider a global temporal grid over the entire time interval on the coarsest level, the AT MGRIT algorithm uses truncated local time grids on the coarsest level, each grid covering certain temporal subintervals. These local grids can be solved completely independent from each other, which reduces the sequential part of the algorithm and, thus, increases parallelism in the method. Here, we study the effect of using truncated local coarse grids on the convergence of the algorithm, both theoretically and numerically, and show, using challenging nonlinear problems, that the new algorithm consistently outperforms classical Parareal MGRIT in terms of time to solution.


Doubly stochastic Yule cascades (Part II) The explosion problem in the non reversible case. We analyze the explosion problem for a class of stochastic models introduced in Part I (arXiv 2103.06912), referred to as doubly stochastic Yule cascades. These models arise naturally in the construction of solutions to evolutionary PDEs as well as in purely probabilistic first passage percolation phenomena having a Markov type statistical dependence, new for this context. Using cut set arguments and a greedy algorithm, we respectively establish criteria for non explosion and explosion without requiring the time reversibility of the underlying branching Markov chain (a condition required in Part I). Notable applications include the explosion of the self similar cascade of the Navier Stokes equations in dimension d 3 and non explosion in dimensions d ge 12 .


Weak and renormalized solutions to a hypoelliptic Mean Field Games system. We establish the existence and uniqueness of weak and renormalized solutions to a degenerate, hypoelliptic Mean Field Games system with local coupling. An important step is to obtain L infty bounds for solutions to a degenerate Fokker Planck equation with a De Giorgi type argument. In particular, we show existence and uniqueness of weak solutions to Mean Fields Games systems with Lipschitz Hamiltonians. Furthermore, we establish existence and uniqueness of renormalized solutions for Hamiltonians with quadratic growth. Our approach relies on the kinetic regularity of hypoelliptic equations obtained by Bouchut and the work of Porretta on the existence and uniqueness of renormalized solutions for the Mean Field Game system, in the non degenerate setting.


Lecture notes for pseudodifferential operators and microlocal analysis. This is a introductory course focusing some basic notions in pseudodifferential operators ( Psi DOs) and microlocal analysis. We start this lecture notes with some notations and necessary preliminaries. Then the notion of symbols and Psi DOs are introduced. In Chapter 3 we define the oscillatory integrals of different types. Chapter 4 is devoted to the stationary phase lemmas. One of the features of the lecture is that the stationary phase lemmas are proved for not only compactly supported functions but also for more general functions with certain order of smoothness and certain order of growth at infinity. We build the results on the stationary phase lemmas. Chapters 5, 6 and 7 covers main results in Psi DOs and the proofs are heavily built on the results in Chapter 4. Some aspects of the semi classical analysis are similar to that of microlocal analysis. In Chapter 8 we finally introduce the notion of wavefront, and Chapter 9 focuses on the propagation of singularities of solution of partial differential equations. Important results are circulated by black boxes and some key steps are marked in red color. Exercises are provided at the end of each chapter.


PP HumanSeg Connectivity Aware Portrait Segmentation with a Large Scale Teleconferencing Video Dataset. As the COVID 19 pandemic rampages across the world, the demands of video conferencing surge. To this end, real time portrait segmentation becomes a popular feature to replace backgrounds of conferencing participants. While feature rich datasets, models and algorithms have been offered for segmentation that extract body postures from life scenes, portrait segmentation has yet not been well covered in a video conferencing context. To facilitate the progress in this field, we introduce an open source solution named PP HumanSeg. This work is the first to construct a large scale video portrait dataset that contains 291 videos from 23 conference scenes with 14K fine labeled frames and extensions to multi camera teleconferencing. Furthermore, we propose a novel Semantic Connectivity aware Learning (SCL) for semantic segmentation, which introduces a semantic connectivity aware loss to improve the quality of segmentation results from the perspective of connectivity. And we propose an ultra lightweight model with SCL for practical portrait segmentation, which achieves the best trade off between IoU and the speed of inference. Extensive evaluations on our dataset demonstrate the superiority of SCL and our model. The source code is available at https github.com PaddlePaddle PaddleSeg.


Rees algebras of ideals of star configurations. In this article we study the defining ideal of Rees algebras of ideals of star configurations. We characterize when these ideals are of linear type and provide sufficient conditions for them to be of fiber type. In the case of star configurations of height two, we give a full description of the defining ideal of the Rees algebra, by explicitly identifying a minimal generating set.


Compact CNN Structure Learning by Knowledge Distillation. The concept of compressing deep Convolutional Neural Networks (CNNs) is essential to use limited computation, power, and memory resources on embedded devices. However, existing methods achieve this objective at the cost of a drop in inference accuracy in computer vision tasks. To address such a drawback, we propose a framework that leverages knowledge distillation along with customizable block wise optimization to learn a lightweight CNN structure while preserving better control over the compression performance tradeoff. Considering specific resource constraints, e.g., floating point operations per inference (FLOPs) or model parameters, our method results in a state of the art network compression while being capable of achieving better inference accuracy. In a comprehensive evaluation, we demonstrate that our method is effective, robust, and consistent with results over a variety of network architectures and datasets, at negligible training overhead. In particular, for the already compact network MobileNet v2, our method offers up to 2x and 5.2x better model compression in terms of FLOPs and model parameters, respectively, while getting 1.05 better model performance than the baseline network.


Convolutional Hough Matching Networks. Despite advances in feature representation, leveraging geometric relations is crucial for establishing reliable visual correspondences under large variations of images. In this work we introduce a Hough transform perspective on convolutional matching and propose an effective geometric matching algorithm, dubbed Convolutional Hough Matching (CHM). The method distributes similarities of candidate matches over a geometric transformation space and evaluate them in a convolutional manner. We cast it into a trainable neural layer with a semi isotropic high dimensional kernel, which learns non rigid matching with a small number of interpretable parameters. To validate the effect, we develop the neural network with CHM layers that perform convolutional matching in the space of translation and scaling. Our method sets a new state of the art on standard benchmarks for semantic visual correspondence, proving its strong robustness to challenging intra class variations.


Normalization Matters in Weakly Supervised Object Localization. Weakly supervised object localization (WSOL) enables finding an object using a dataset without any localization information. By simply training a classification model using only image level annotations, the feature map of the model can be utilized as a score map for localization. In spite of many WSOL methods proposing novel strategies, there has not been any de facto standard about how to normalize the class activation map (CAM). Consequently, many WSOL methods have failed to fully exploit their own capacity because of the misuse of a normalization method. In this paper, we review many existing normalization methods and point out that they should be used according to the property of the given dataset. Additionally, we propose a new normalization method which substantially enhances the performance of any CAM based WSOL methods. Using the proposed normalization method, we provide a comprehensive evaluation over three datasets (CUB, ImageNet and OpenImages) on three different architectures and observe significant performance gains over the conventional min max normalization method in all the evaluated cases.


Liquidity Provision with Adverse Selection and Inventory Costs. We study one shot Nash competition between an arbitrary number of identical dealers that compete for the order flow of a client. The client trades either because of proprietary information, exposure to idiosyncratic risk, or a mix of both trading motives. When quoting their price schedules, the dealers do not know the client's type but only its distribution, and in turn choose their price quotes to mitigate between adverse selection and inventory costs. Under essentially minimal conditions, we show that a unique symmetric Nash equilibrium exists and can be characterized by the solution of a nonlinear ODE.


BI RADS BERT Using Section Segmentation to Understand Radiology Reports. Radiology reports are one of the main forms of communication between radiologists and other clinicians and contain important information for patient care. In order to use this information for research and automated patient care programs, it is necessary to convert the raw text into structured data suitable for analysis. State of the art natural language processing (NLP) domain specific contextual word embeddings have been shown to achieve impressive accuracy for these tasks in medicine, but have yet to be utilized for section structure segmentation. In this work, we pre trained a contextual embedding BERT model using breast radiology reports and developed a classifier that incorporated the embedding with auxiliary global textual features in order to perform section segmentation. This model achieved a 98 accuracy at segregating free text reports sentence by sentence into sections of information outlined in the Breast Imaging Reporting and Data System (BI RADS) lexicon, a significant improvement over the Classic BERT model without auxiliary information. We then evaluated whether using section segmentation improved the downstream extraction of clinically relevant information such as modality procedure, previous cancer, menopausal status, the purpose of the exam, breast density, and breast MRI background parenchymal enhancement. Using the BERT model pre trained on breast radiology reports combined with section segmentation resulted in an overall accuracy of 95.9 in the field extraction tasks. This is a 17 improvement compared to an overall accuracy of 78.9 for field extraction with models using Classic BERT embeddings and not using section segmentation. Our work shows the strength of using BERT in radiology report analysis and the advantages of section segmentation in identifying key features of patient factors recorded in breast radiology reports.


On the q analogue of the pair correlation conjecture via Fourier optimization. We study the q analogue of the average of Montgomery's function F( alpha, T) over bounded intervals. Assuming the Generalized Riemann Hypothesis for Dirichlet L functions, we obtain upper and lower bounds for this average over an interval that are quite close to the pointwise conjectured value of 1. To compute our bounds, we extend a Fourier analysis approach by Carneiro, Chandee, Chirre, and Milinovich, and apply computational methods of non smooth programming.


Quantitative Russo Seymour Welsh for random walk on random graphs and decorrelation of UST. We prove a quantitative Russo Seymour Welsh (RSW) type result for random walks on two natural examples of random planar graphs the supercritical percolation cluster in the square lattice and the Poisson Voronoi triangulation in the plane. More precisely, we prove that the probability that a simple random walk crosses a rectangle in the hard direction with uniformly positive probability is stretched exponentially likely in the size of the rectangle. As an application we prove a near optimal decorrelation result for uniform spanning trees for such graphs. This is the key missing step in this setup while applying of the proof stretegy of a previous article on universality of dimers ("Dimers and imaginary geometry." Ann. Probab. 48 (1) 1 52) where random walk RSW was assumed to hold with probability 1. Applications to almost sure Gaussian free field scaling limit for dimers on Temperleyan type modification on such graphs are also discussed.


Comparing formulas for type GL n Macdonald polynomials Supplement. This paper is a supplement to Guo Ram arXiv 2104.02942, containing examples, remarks and additional material that could be useful to researchers working with Type GL n Macdonald polynomials. In the course of our comparison of the alcove walk formula and the nonattacking fillings formulas for type GL n Macdonald polynomials we did many examples and significant analysis of the literature. In the preparation of Guo Ram arXiv 2104.02942 it seemed sensible to produce a document with focus and this material was removed. This is paper resurrects and organizes that material, in hopes that others may also find it useful.


Multi Objective Reconstruction Of Software Architecture. Design erosion is a persistent problem within the software engineering discipline. Software designs tend to deteriorate over time and there is a need for tools and techniques that support software architects when dealing with legacy systems. This paper presents an evaluation of a Search Based Software Engineering (SBSE) approach intended to recover high level architecture designs of software systems by structuring low level artefacts into high level architecture artefact configurations. In particular , this paper describes the performance evaluation of a number of metaheuristic search algorithms applied to architecture reconstruction problems with high dimensionality in terms of objectives. These problems have been selected as representative of the typical challenges faced by software architects dealing with legacy systems and the results inform the ongoing developed of a software tool that supports the analysis of trade offs between different reconstructed architectures.


Materialized Knowledge Bases from Commonsense Transformers. Starting from the COMET methodology by Bosselut et al. (2019), generating commonsense knowledge directly from pre trained language models has recently received significant attention. Surprisingly, up to now no materialized resource of commonsense knowledge generated this way is publicly available. This paper fills this gap, and uses the materialized resources to perform a detailed analysis of the potential of this approach in terms of precision and recall. Furthermore, we identify common problem cases, and outline use cases enabled by materialized resources. We posit that the availability of these resources is important for the advancement of the field, as it enables an off the shelf use of the resulting knowledge, as well as further analyses on its strengths and weaknesses.


Penalty and Augmented Lagrangian Methods for Constrained DC Programming. In this paper we consider a class of structured nonsmooth difference of convex (DC) constrained DC program in which the first convex component of the objective and constraints is the sum of a smooth and nonsmooth functions while their second convex component is the supremum of finitely many convex smooth functions. The existing methods for this problem usually have a weak convergence guarantee or require a feasible initial point. Inspired by the recent work (Math Oper. Res. 42(1) 95 118, 2017 by Pang et al.), in this paper we propose two infeasible methods with strong convergence guarantee for the considered problem. The first one is a penalty method that consists of finding an approximate D stationary point of a sequence of penalty subproblems. We show that any feasible accumulation point of the solution sequence generated by such a penalty method is a B stationary point of the problem under a weakest possible assumption that it satisfies a pointwise Slater constraint qualification (PSCQ). The second one is an augmented Lagrangian (AL) method that consists of finding an approximate D stationary point of a sequence of AL subproblems. Under the same PSCQ condition as for the penalty method, we show that any feasible accumulation point of the solution sequence generated by such an AL method is a B stationary point of the problem, and moreover, it satisfies a KKT type of optimality condition for the problem, together with any accumulation point of the sequence of a set of auxiliary Lagrangian multipliers. We also propose an efficient successive convex approximation method for computing an approximate D stationary point of the penalty and AL subproblems. Finally, some numerical experiments are conducted to demonstrate the efficiency of our proposed methods.


A proof of a conjecture on Ramsey numbers B(2,2,3) . The bipartite Ramsey number B(n 1,n 2, ldots,n t) is the least positive integer b such that, any coloring of the edges of K b,b with t colors will result in a monochromatic copy of K n i,n i in the i th color, for some i , 1 leq i leq t . In this paper we obtain the exact values of bipartite Ramsey numbers B(2,2,3) . In particular, we prove the conjecture of Radziszowski at al. aobut B(2,2,3) which was introduced in 2015. In fact we prov that B(2,2,3) 17 .


Adjoint Rigid Transform Network Task conditioned Alignment of 3D Shapes. Most learning methods for 3D data (point clouds, meshes) suffer significant performance drops when the data is not carefully aligned to a canonical orientation. Aligning real world 3D data collected from different sources is non trivial and requires manual intervention. In this paper, we propose the Adjoint Rigid Transform (ART) Network, a neural module which can be integrated with a variety of 3D networks to significantly boost their performance. ART learns to rotate input shapes to a learned canonical orientation, which is crucial for a lot of tasks such as shape reconstruction, interpolation, non rigid registration, and latent disentanglement. ART achieves this with self supervision and a rotation equivariance constraint on predicted rotations. The remarkable result is that with only self supervision, ART facilitates learning a unique canonical orientation for both rigid and nonrigid shapes, which leads to a notable boost in performance of aforementioned tasks. We will release our code and pre trained models for further research.


Enhancing Real World Adversarial Patches through 3D Modeling of Complex Target Scenes. Adversarial examples have proven to be a concerning threat to deep learning models, particularly in the image domain. However, while many studies have examined adversarial examples in the real world, most of them relied on 2D photos of the attack scene. As a result, the attacks proposed may have limited effectiveness when implemented in realistic environments with 3D objects or varied conditions. There are few studies on adversarial learning that use 3D objects, and in many cases, other researchers are unable to replicate the real world evaluation process. In this study, we present a framework that uses 3D modeling to craft adversarial patches for an existing real world scene. Our approach uses a 3D digital approximation of the scene as a simulation of the real world. With the ability to add and manipulate any element in the digital scene, our framework enables the attacker to improve the adversarial patch's impact in real world settings. We use the framework to create a patch for an everyday scene and evaluate its performance using a novel evaluation process that ensures that our results are reproducible in both the digital space and the real world. Our evaluation results show that the framework can generate adversarial patches that are robust to different settings in the real world.


Unconditional energy dissipation and error estimates of the SAV Fourier spectral method for nonlinear fractional generalized wave equation. In this paper, we consider a second order scalar auxiliary variable (SAV) Fourier spectral method to solve the nonlinear fractional generalized wave equation. Unconditional energy conservation or dissipation properties of the fully discrete scheme are first established. Next, we utilize the temporal spatial error splitting argument to obtain unconditional optimal error estimate of the fully discrete scheme, which overcomes time step restrictions caused by strongly nonlinear system, or the restrictions that the nonlinear term needs to satisfy the assumption of global Lipschitz condition in all previous works for fractional undamped or damped wave equations. Finally, some numerical experiments are presented to confirm our theoretical analysis.


Costly Features Classification using Monte Carlo Tree Search. We consider the problem of costly feature classification, where we sequentially select the subset of features to make a balance between the classification error and the feature cost. In this paper, we first cast the task into a MDP problem and use Advantage Actor Critic algorithm to solve it. In order to further improve the agent's performance and make the policy explainable, we employ the Monte Carlo Tree Search to update the policy iteratively. During the procedure, we also consider its performance on the unbalanced dataset and its sensitivity to the missing value. We evaluate our model on multiple datasets and find it outperforms other methods.


Microlocation for Smart Buildings in the Era of the Internet of Things A Survey of Technologies, Techniques, and Approaches. Microlocation plays a key role in the transformation of traditional buildings into smart infrastructure. Microlocation is the process of locating any entity with a very high accuracy, possibly in centimeters. Such technologies require high detection accuracy, energy efficiency, wide reception range, low cost, and availability. In this article, we provide insights into various microlocation enabling technologies, techniques, and services and discuss how they can accelerate the incorporation of the Internet of Things (IoT) in smart buildings. We cover the challenges and examine some signal processing filtering techniques such that microlocation enabling technologies and services can be thoroughly integrated with an IoT equipped smart building. An experiment with Bluetooth Low Energy (BLE) beacons used for microlocation is also presented.


DROMO Distributionally Robust Offline Model based Policy Optimization. We consider the problem of offline reinforcement learning with model based control, whose goal is to learn a dynamics model from the experience replay and obtain a pessimism oriented agent under the learned model. Current model based constraint includes explicit uncertainty penalty and implicit conservative regularization that pushes Q values of out of distribution state action pairs down and the in distribution up. While the uncertainty estimation, on which the former relies on, can be loosely calibrated for complex dynamics, the latter performs slightly better. To extend the basic idea of regularization without uncertainty quantification, we propose distributionally robust offline model based policy optimization (DROMO), which leverages the ideas in distributionally robust optimization to penalize a broader range of out of distribution state action pairs beyond the standard empirical out of distribution Q value minimization. We theoretically show that our method optimizes a lower bound on the ground truth policy evaluation, and it can be incorporated into any existing policy gradient algorithms. We also analyze the theoretical properties of DROMO's linear and non linear instantiations.


Alpha Matte Generation from Single Input for Portrait Matting. In the portrait matting, the goal is to predict an alpha matte that identifies the effect of each pixel on the foreground subject. Traditional approaches and most of the existing works utilized an additional input, e.g., trimap, background image, to predict alpha matte. However, (1) providing additional input is not always practical, and (2) models are too sensitive to these additional inputs. To address these points, in this paper, we introduce an additional input free approach to perform portrait matting. We divide the task into two subtasks, segmentation and alpha matte prediction. We first generate a coarse segmentation map from the input image and then predict the alpha matte by utilizing the image and segmentation map. Besides, we present a segmentation encoding block to downsample the coarse segmentation map and provide useful feature representation to the residual block, since using a single encoder causes the vanishing of the segmentation information. We tested our model on four different benchmark datasets. The proposed method outperformed the MODNet and MGMatting methods that also take a single input. Besides, we obtained comparable results with BGM V2 and FBA methods that require additional input.


Event Based high speed low latency fiducial marker tracking. Motion and dynamic environments, especially under challenging lighting conditions, are still an open issue for robust robotic applications. In this paper, we propose an end to end pipeline for real time, low latency, 6 degrees of freedom pose estimation of fiducial markers. Instead of achieving a pose estimation through a conventional frame based approach, we employ the high speed abilities of event based sensors to directly refine the spatial transformation, using consecutive events. Furthermore, we introduce a novel two way verification process for detecting tracking errors by backtracking the estimated pose, allowing us to evaluate the quality of our tracking. This approach allows us to achieve pose estimation at a rate up to 156 kHz, while only relying on CPU resources. The average end to end latency of our method is 3 ms. Experimental results demonstrate outstanding potential for robotic tasks, such as visual servoing in fast action perception loops.


On the application of the SCD semismooth Newton method to variational inequalities of the second kind. The paper starts with a description of the SCD (subspace containing derivative) mappings and the SCD semismooth Newton method for the solution of general inclusions. This method is then applied to a class of variational inequalities of the second kind. As a result, one obtains an implementable algorithm exhibiting a locally superlinear convergence. Thereafter we suggest several globally convergent hybrid algorithms in which one combines the SCD semismooth Newton method with selected splitting algorithms for the solution of monotone variational inequalities. Finally we demonstrate the efficiency of one of these methods via a Cournot Nash equilibrium, modeled as a variational inequalities of the second kind, where one admits really large numbers of players (firms) and produced commodities.


Existence and uniqueness of solutions for a nonlinear equation with convection term. In this paper, we consider the existence and uniqueness of weak solutions of a nonlinear elliptic equation with a variable exponent, a monotonic type operator and a convection term. With the topological degree theory, we prove the existence of at least one weak solution under some Leray Lions and growth conditions. Moreover, we obtain the uniqueness of the solution of the problem under some additional assumptions. Our results generalize and improve existing results with another approach.


Biquandle Bracket Quivers. Biquandle brackets define invariants of classical and virtual knots and links using skein invariants of biquandle colored knots and links. Biquandle coloring quivers categorify the biquandle counting invariant in the sense of defining quiver valued enhancements which decategorify to the counting invariant. In this paper we unite the two ideas to define biquandle bracket quivers, providing new categorifications of biquandle brackets. In particular, our construction provides an infinite family of categorifications of the Jones polynomial and other classical skein invariants.