How to find a good image text embedding for remote sensing visual question answering?. Visual question answering (VQA) has recently been introduced to remote sensing to make information extraction from overhead imagery more accessible to everyone. VQA considers a question (in natural language, therefore easy to formulate) about an image and aims at providing an answer through a model based on computer vision and natural language processing methods. As such, a VQA model needs to jointly consider visual and textual features, which is frequently done through a fusion step. In this work, we study three different fusion methodologies in the context of VQA for remote sensing and analyse the gains in accuracy with respect to the model complexity. Our findings indicate that more complex fusion mechanisms yield an improved performance, yet that seeking a trade of between model complexity and performance is worthwhile in practice.


Investigating Awareness and usage of Electronic Resources by the Library Users of Selected Colleges of Solapur University. The study investigated the use of electronic resources information by library users in selected colleges of Solapur University. Specifically, to investigate the awareness and level of use of electronic resources perceived reliance, benefits and impact of use of electronic resources on the research activities. The research design for the study was a survey. Questionnaire schedule was used to collect data from 1022 library users from selected colleges of Solapur University. The result revealed that preponderance of users from aided 33.51 Self financing 26.10 and Education colleges 43.24 preferred to visit the Library once in three days. While analyzing the entire college libraries regarding the frequency of visit, users gave first preference to once in three days i.e. 27.2 . College wise analysis reveals that mainstream of users from Aided Colleges 38 , Self financing Colleges 28.3 , Engineering Colleges 43 , Education colleges 53.2 and Pharmacy Colleges 23.4 are spending their time 1 2 hrs in libraries and 40.8 visit college libraries to issue and return books and in the device usage (33.9 ) of users ranked mobile phone as the second device for accessing the e resources. It is noticeable that 24.7 of users acknowledge from Aided Colleges know about the services of the Library from website but in Self Finance Colleges 8.5 and Pharmacy College 56.4 users aware about the services from the friends it is observed that most of the web technologies are not used by the mainstream of the users due to lack of awareness, training etc.


CREAK A Dataset for Commonsense Reasoning over Entity Knowledge. Most benchmark datasets targeting commonsense reasoning focus on everyday scenarios physical knowledge like knowing that you could fill a cup under a waterfall Talmor et al., 2019 , social knowledge like bumping into someone is awkward Sap et al., 2019 , and other generic situations. However, there is a rich space of commonsense inferences anchored to knowledge about specific entities for example, deciding the truthfulness of a claim "Harry Potter can teach classes on how to fly on a broomstick." Can models learn to combine entity knowledge with commonsense reasoning in this fashion? We introduce CREAK, a testbed for commonsense reasoning about entity knowledge, bridging fact checking about entities (Harry Potter is a wizard and is skilled at riding a broomstick) with commonsense inferences (if you're good at a skill you can teach others how to do it). Our dataset consists of 13k human authored English claims about entities that are either true or false, in addition to a small contrast set. Crowdworkers can easily come up with these statements and human performance on the dataset is high (high 90s) we argue that models should be able to blend entity knowledge and commonsense reasoning to do well here. In our experiments, we focus on the closed book setting and observe that a baseline model finetuned on existing fact verification benchmark struggles on CREAK. Training a model on CREAK improves accuracy by a substantial margin, but still falls short of human performance. Our benchmark provides a unique probe into natural language understanding models, testing both its ability to retrieve facts (e.g., who teaches at the University of Chicago?) and unstated commonsense knowledge (e.g., butlers do not yell at guests).


Robust and Cheap Framework for Network Resilience A Novel Mixed Integer Formulation and Solution Method. Resilience and robustness are important properties in the reliability and attack tolerance analysis of networks. In recent decades, various qualitative and heuristic based quantitative approaches have made significant contributions in addressing network resilience and robustness. However, the lack of exact methods such as mixed integer programming (MIP) models is sensible in the literature. In this paper, we contribute to the literature on the network resilience and robustness for targeted and random attacks and propose a MIP model considering graph theoretical aspects of networks. The proposed MIP model consists of two stages where in the first stage the worst case attack is identified. Then, the second stage problem maximizes the network resilience under the worst case attack by adding links considering a link addition financial budget. In addition, we propose a solution method that (i) provides a tight relaxation for the MIP formulation by relaxing some of the integrality restrictions, (ii) exploits the structure of the problem and reduces the second stage problem to a less complex but equivalent problem, and (iii) identifies underlying knapsack constraints and generates lifted cover inequalities (LCI) for such constraints. We conclude numerical experiments for randomly generated networks and then extend our results to power system networks. Numerical experiments demonstrate the applicability and computational efficiency of the proposed robust and cheap framework for network resilience.


On the logical structure of choice and bar induction principles. We develop an approach to choice principles and their contrapositive bar induction principles as extensionality schemes connecting an "intensional" or "effective" view of respectively ill and well foundedness properties to an "extensional" or "ideal" view of these properties. After classifying and analysing the relations between different intensional definitions of ill foundedness and well foundedness, we introduce, for a domain A , a codomain B and a "filter" T on finite approximations of functions from A to B , a generalised form GDC A,B,T of the axiom of dependent choice and dually a generalised bar induction principle GBI A,B,T such that GDC A,B,T intuitionistically captures the strength of bullet the general axiom of choice expressed as forall a exists b R(a, b) Rightarrow exists alpha forall alpha R( alpha, alpha(a)) when T is a filter that derives point wise from a relation R on A times B without introducing further constraints, bullet the Boolean Prime Filter Theorem Ultrafilter Theorem if B is the two element set mathbb B (for a constructive definition of prime filter), bullet the axiom of dependent choice if A mathbb N , bullet Weak K "o nig's Lemma if A mathbb N and B mathbb B (up to weak classical reasoning) GBI A,B,T intuitionistically captures the strength of bullet G "o del's completeness theorem in the form validity implies provability for entailment relations if B mathbb B , bullet bar induction when A mathbb N , bullet the Weak Fan Theorem when A mathbb N and B mathbb B . Contrastingly, even though GDC A,B,T and GBI A,B,T smoothly capture several variants of choice and bar induction, some instances are inconsistent, e.g. when A is mathbb B mathbb N and B is mathbb N .


"Are you sure?" Preliminary Insights from Scaling Product Comparisons to Multiple Shops. Large eCommerce players introduced comparison tables as a new type of recommendations. However, building comparisons at scale without pre existing training taxonomy data remains an open challenge, especially within the operational constraints of shops in the long tail. We present preliminary results from building a comparison pipeline designed to scale in a multi shop scenario we describe our design choices and run extensive benchmarks on multiple shops to stress test it. Finally, we run a small user study on property selection and conclude by discussing potential improvements and highlighting the questions that remain to be addressed.


VELOC VEry Low Overhead Checkpointing in the Age of Exascale. Checkpointing large amounts of related data concurrently to stable storage is a common I O pattern of many HPC applications. However, such a pattern frequently leads to I O bottlenecks that lead to poor scalability and performance. As modern HPC infrastructures continue to evolve, there is a growing gap between compute capacity vs. I O capabilities. Furthermore, the storage hierarchy is becoming increasingly heterogeneous in addition to parallel file systems, it comprises burst buffers, key value stores, deep memory hierarchies at node level, etc. In this context, state of art is insufficient to deal with the diversity of vendor APIs, performance and persistency characteristics. This extended abstract presents an overview of VeloC (Very Low Overhead Checkpointing System), a checkpointing runtime specifically design to address these challenges for the next generation Exascale HPC applications and systems. VeloC offers a simple API at user level, while employing an advanced multi level resilience strategy that transparently optimizes the performance and scalability of checkpointing by leveraging heterogeneous storage.


The Hirzebruch Mumford covolume of some hermitian lattices. Let L diag(1,1, ldots,1, 1) and M diag(1,1, ldots,1, 2) be the lattices of signature (n,1) . We consider the groups Gamma SU(L, mathcal O K) and Gamma' SU(M, mathcal O K) for an imaginary quadratic field K mathbb Q ( sqrt d ) of discriminant D and it's ring of integers mathcal O K , d odd and square free. We compute the Hirzebruch Mumford volume of the factor spaces mathbb B n Gamma and mathbb B n Gamma' . The result for the factor space mathbb B n Gamma is due to Zeltinger, but as we're using it to prove the result for mathbb B n Gamma' and it is hard to find his article, we prove the first result here as well.


Predicting publication productivity for authors Shallow or deep architecture?. Academic administrators and funding agencies must predict the publication productivity of research groups and individuals to assess authors' abilities. However, such prediction remains an elusive task due to the randomness of individual research and the diversity of authors' productivity patterns. We applied two kinds of approaches to this prediction task deep neural network learning and model based approaches. We found that a neural network cannot give a good long term prediction for groups, while the model based approaches cannot provide short term predictions for individuals. We proposed a model that integrates the advantages of both data driven and model based approaches, and the effectiveness of this method was validated by applying it to a high quality dblp dataset, demonstrating that the proposed model outperforms the tested data driven and model based approaches.


Doxastic Extensions of L ukasiewicz Logic. We propose two new doxastic extensions of fuzzy L ukasiewicz logic in which their semantics are Kripke based with both fuzzy atomic propositions and fuzzy accessibility relations. A class of these extensions is equipped with uninformed belief operator, and the other class is based on a new notion of skeptical belief. We model a fuzzy version of muddy children problem and a CPA security experiment using uniformed belief and skeptical belief, respectively. Moreover, we prove soundness and completeness for both of these belief extensions.


Integrating Heuristics and Learning in a Computational Architecture for Cognitive Trading. The successes of Artificial Intelligence in recent years in areas such as image analysis, natural language understanding and strategy games have sparked interest from the world of finance. Specifically, there are high expectations, and ongoing engineering projects, regarding the creation of artificial agents, known as robotic traders, capable of juggling the financial markets with the skill of experienced human traders. Obvious economic implications aside, this is certainly an area of great scientific interest, due to the challenges that such a real context poses to the use of AI techniques. Precisely for this reason, we must be aware that artificial agents capable of operating at such levels are not just round the corner, and that there will be no simple answers, but rather a concurrence of various technologies and methods to the success of the effort. In the course of this article, we review the issues inherent in the design of effective robotic traders as well as the consequently applicable solutions, having in view the general objective of bringing the current state of the art of robo trading up to the next level of intelligence, which we refer to as Cognitive Trading. Key to our approach is the joining of two methodological and technological directions which, although both deeply rooted in the disciplinary field of artificial intelligence, have so far gone their separate ways heuristics and learning.


The Levy Flight of Cities Analyzing Social Economical Trajectories with Auto Embedding. It has been found that human mobility exhibits random patterns following the Levy flight, where human movement contains many short flights and some long flights, and these flights follow a power law distribution. In this paper, we study the social economical development trajectories of urban cities. We observe that social economical movement of cities also exhibit the Levy flight characteristics. We collect the social and economical data such as the population, the number of students, GDP and personal income, etc. from several cities. Then we map these urban data into the social and economical factors through a deep learning embedding method Auto Encoder. We find that the social economical factors of these cities can be fitted approximately as a movement pattern of a power law distribution. We use the Stochastic Multiplicative Processes (SMP) to explain such movement, where in the presence of a boundary constraint, the SMP leads to a power law distribution. It means that the social economical trajectories of cities also follow a Levy flight pattern, where some years have large changes in terms of social economical development, and many years have little changes.


Modelling the development of counting with memory augmented neural networks. Learning to count is an important example of the broader human capacity for systematic generalization, and the development of counting is often characterized by an inflection point when children rapidly acquire proficiency with the procedures that support this ability. We aimed to model this process by training a reinforcement learning agent to select N items from a binary vector when instructed (known as the give N task). We found that a memory augmented modular network architecture based on the recently proposed Emergent Symbol Binding Network (ESBN) exhibited an inflection during learning that resembled human development. This model was also capable of systematic extrapolation outside the range of its training set for example, trained only to select between 1 and 10 items, it could succeed at selecting 11 to 15 items as long as it could make use of an arbitrary count sequence of at least that length. The close parallels to child development and the capacity for extrapolation suggest that our model could shed light on the emergence of systematicity in humans.


Optical Mouse 3D Mouse Pose From Single View Video. We present a method to infer the 3D pose of mice, including the limbs and feet, from monocular videos. Many human clinical conditions and their corresponding animal models result in abnormal motion, and accurately measuring 3D motion at scale offers insights into health. The 3D poses improve classification of health related attributes over 2D representations. The inferred poses are accurate enough to estimate stride length even when the feet are mostly occluded. This method could be applied as part of a continuous monitoring system to non invasively measure animal health.


Personal Fixations Based Object Segmentation with Object Localization and Boundary Preservation. As a natural way for human computer interaction, fixation provides a promising solution for interactive image segmentation. In this paper, we focus on Personal Fixations based Object Segmentation (PFOS) to address issues in previous studies, such as the lack of appropriate dataset and the ambiguity in fixations based interaction. In particular, we first construct a new PFOS dataset by carefully collecting pixel level binary annotation data over an existing fixation prediction dataset, such dataset is expected to greatly facilitate the study along the line. Then, considering characteristics of personal fixations, we propose a novel network based on Object Localization and Boundary Preservation (OLBP) to segment the gazed objects. Specifically, the OLBP network utilizes an Object Localization Module (OLM) to analyze personal fixations and locates the gazed objects based on the interpretation. Then, a Boundary Preservation Module (BPM) is designed to introduce additional boundary information to guard the completeness of the gazed objects. Moreover, OLBP is organized in the mixed bottom up and top down manner with multiple types of deep supervision. Extensive experiments on the constructed PFOS dataset show the superiority of the proposed OLBP network over 17 state of the art methods, and demonstrate the effectiveness of the proposed OLM and BPM components. The constructed PFOS dataset and the proposed OLBP network are available at https github.com MathLee OLBPNet4PFOS.


PTR Prompt Tuning with Rules for Text Classification. Fine tuned pre trained language models (PLMs) have achieved awesome performance on almost all NLP tasks. By using additional prompts to fine tune PLMs, we can further stimulate the rich knowledge distributed in PLMs to better serve downstream tasks. Prompt tuning has achieved promising results on some few class classification tasks such as sentiment classification and natural language inference. However, manually designing lots of language prompts is cumbersome and fallible. For those auto generated prompts, it is also expensive and time consuming to verify their effectiveness in non few shot scenarios. Hence, it is still challenging for prompt tuning to address many class classification tasks. To this end, we propose prompt tuning with rules (PTR) for many class text classification and apply logic rules to construct prompts with several sub prompts. In this way, PTR is able to encode prior knowledge of each class into prompt tuning. We conduct experiments on relation classification, a typical and complicated many class classification task, and the results show that PTR can significantly and consistently outperform existing state of the art baselines. This indicates that PTR is a promising approach to take advantage of both human prior knowledge and PLMs for those complicated classification tasks.


Self Ensemling for 3D Point Cloud Domain Adaption. Recently 3D point cloud learning has been a hot topic in computer vision and autonomous driving. Due to the fact that it is difficult to manually annotate a qualitative large scale 3D point cloud dataset, unsupervised domain adaptation (UDA) is popular in 3D point cloud learning which aims to transfer the learned knowledge from the labeled source domain to the unlabeled target domain. However, the generalization and reconstruction errors caused by domain shift with simply learned model are inevitable which substantially hinder the model's capability from learning good representations. To address these issues, we propose an end to end self ensembling network (SEN) for 3D point cloud domain adaption tasks. Generally, our SEN resorts to the advantages of Mean Teacher and semi supervised learning, and introduces a soft classification loss and a consistency loss, aiming to achieve consistent generalization and accurate reconstruction. In SEN, a student network is kept in a collaborative manner with supervised learning and self supervised learning, and a teacher network conducts temporal consistency to learn useful representations and ensure the quality of point clouds reconstruction. Extensive experiments on several 3D point cloud UDA benchmarks show that our SEN outperforms the state of the art methods on both classification and segmentation tasks. Moreover, further analysis demonstrates that our SEN also achieves better reconstruction results.


DIPPA An improved Method for Bilinear Saddle Point Problems. This paper studies bilinear saddle point problems min bf x max bf y g( bf x ) bf x top bf A bf y h( bf y ) , where the functions g, h are smooth and strongly convex. When the gradient and proximal oracle related to g and h are accessible, optimal algorithms have already been developed in the literature cite chambolle2011first, palaniappan2016stochastic . However, the proximal operator is not always easy to compute, especially in constraint zero sum matrix games cite zhang2020sparsified . This work proposes a new algorithm which only requires the access to the gradients of g, h . Our algorithm achieves a complexity upper bound tilde mathcal O left( frac bf A 2 sqrt mu x mu y sqrt 4 kappa x kappa y ( kappa x kappa y) right) which has optimal dependency on the coupling condition number frac bf A 2 sqrt mu x mu y up to logarithmic factors.


Relative Perversity. We define and study a relative perverse t structure associated with any finitely presented morphism of schemes f X to S , with relative perversity equivalent to perversity of the restrictions to all geometric fibres of f . The existence of this t structure is closely related to perverse t exactness properties of nearby cycles. This t structure preserves universally locally acyclic sheaves, and one gets a resulting abelian category mathrm Perv mathrm ULA (X S) with many of the same properties familiar in the absolute setting (e.g., noetherian, artinian, compatible with Verdier duality). For S connected and geometrically unibranch with generic point eta , the functor mathrm Perv mathrm ULA (X S) to mathrm Perv (X eta) is exact and fully faithful, and its essential image is stable under passage to subquotients. This yields a notion of "good reduction" for perverse sheaves.


Where2Act From Pixels to Actions for Articulated 3D Objects. One of the fundamental goals of visual perception is to allow agents to meaningfully interact with their environment. In this paper, we take a step towards that long term goal we extract highly localized actionable information related to elementary actions such as pushing or pulling for articulated objects with movable parts. For example, given a drawer, our network predicts that applying a pulling force on the handle opens the drawer. We propose, discuss, and evaluate novel network architectures that given image and depth data, predict the set of actions possible at each pixel, and the regions over articulated parts that are likely to move under the force. We propose a learning from interaction framework with an online data sampling strategy that allows us to train the network in simulation (SAPIEN) and generalizes across categories. Check the website for code and data release https cs.stanford.edu kaichun where2act


Rethinking Natural Adversarial Examples for Classification Models. Recently, it was found that many real world examples without intentional modifications can fool machine learning models, and such examples are called "natural adversarial examples". ImageNet A is a famous dataset of natural adversarial examples. By analyzing this dataset, we hypothesized that large, cluttered and or unusual background is an important reason why the images in this dataset are difficult to be classified. We validated the hypothesis by reducing the background influence in ImageNet A examples with object detection techniques. Experiments showed that the object detection models with various classification models as backbones obtained much higher accuracy than their corresponding classification models. A detection model based on the classification model EfficientNet B7 achieved a top 1 accuracy of 53.95 , surpassing previous state of the art classification models trained on ImageNet, suggesting that accurate localization information can significantly boost the performance of classification models on ImageNet A. We then manually cropped the objects in images from ImageNet A and created a new dataset, named ImageNet A Plus. A human test on the new dataset showed that the deep learning based classifiers still performed quite poorly compared with humans. Therefore, the new dataset can be used to study the robustness of classification models to the internal variance of objects without considering the background disturbance.


Extracting and Measuring Uncertain Biomedical Knowledge from Scientific Statements. Purpose This study aims to develop a novel approach to extracting and measuring uncertain biomedical knowledge from scientific statements. Design methodology approach Taking cardiovascular research publications in China as a sample, we extracted the SPO triples as knowledge unit and the hedging conflicting uncertainties as the knowledge context. We introduced Information Entropy and Uncertainty Rate as potential metrics to quantity the uncertainty of biomedical knowledge claims represented at different levels, such as the SPO triples (micro level), as well as the semantic type pairs (micro level). Findings The results indicated that while the number of scientific publications and total SPO triples showed a liner growth, the novel SPO triples occurring per year remained stable. After examining the frequency of uncertain cue words in different part of scientific statements, we found hedging words tend to appear in conclusive and purposeful sentences, whereas conflicting terms often appear in background and act as the premise (e.g., unsettled scientific issues) of the work to be investigated. Practical implications Our approach identified major uncertain knowledge areas, such as diagnostic biomarkers, genetic characteristics, and pharmacologic therapies surrounding cardiovascular diseases in China. These areas are suggested to be prioritized in which new hypotheses need to be verified, and disputes, conflicts, as well as contradictions to be settled further.


An Influence based Approach for Root Cause Alarm Discovery in Telecom Networks. Alarm root cause analysis is a significant component in the day to day telecommunication network maintenance, and it is critical for efficient and accurate fault localization and failure recovery. In practice, accurate and self adjustable alarm root cause analysis is a great challenge due to network complexity and vast amounts of alarms. A popular approach for failure root cause identification is to construct a graph with approximate edges, commonly based on either event co occurrences or conditional independence tests. However, considerable expert knowledge is typically required for edge pruning. We propose a novel data driven framework for root cause alarm localization, combining both causal inference and network embedding techniques. In this framework, we design a hybrid causal graph learning method (HPCI), which combines Hawkes Process with Conditional Independence tests, as well as propose a novel Causal Propagation Based Embedding algorithm (CPBE) to infer edge weights. We subsequently discover root cause alarms in a real time data stream by applying an influence maximization algorithm on the weighted graph. We evaluate our method on artificial data and real world telecom data, showing a significant improvement over the best baselines.


Privacy Preserving Communication Efficient Federated Multi Armed Bandits. Communication bottleneck and data privacy are two critical concerns in federated multi armed bandit (MAB) problems, such as situations in decision making and recommendations of connected vehicles via wireless. In this paper, we design the privacy preserving communication efficient algorithm in such problems and study the interactions among privacy, communication and learning performance in terms of the regret. To be specific, we design privacy preserving learning algorithms and communication protocols and derive the learning regret when networked private agents are performing online bandit learning in a master worker, a decentralized and a hybrid structure. Our bandit learning algorithms are based on epoch wise sub optimal arm eliminations at each agent and agents exchange learning knowledge with the server each other at the end of each epoch. Furthermore, we adopt the differential privacy (DP) approach to protect the data privacy at each agent when exchanging information and we curtail communication costs by making less frequent communications with fewer agents participation. By analyzing the regret of our proposed algorithmic framework in the master worker, decentralized and hybrid structures, we theoretically show tradeoffs between regret and communication costs privacy. Finally, we empirically show these trade offs which are consistent with our theoretical analysis.


New Gaussian Riesz transforms on variable Lebesgue spaces. We give sufficient conditions on the exponent p mathbb R d rightarrow 1, infty) for the boundedness of the non centered Gaussian maximal function on variable Lebesgue spaces L p( cdot) ( mathbb R d, gamma d) , as well as of the new higher order Riesz transforms associated with the Ornstein Uhlenbeck semigroup, which are the natural extensions of the supplementary first order Gaussian Riesz transforms defined by A. Nowak and K. Stempak in cite nowakstempak .


A Smoother Notion of Spread Hypergraphs. Alweiss, Lovett, Wu, and Zhang introduced q spread hypergraphs in their breakthrough work regarding the sunflower conjecture, and since then q spread hypergraphs have been used to give short proofs of several outstanding problems in probabilistic combinatorics. A variant of q spread hypergraphs was implicitly used by Kahn, Narayanan, and Park to determine the threshold for when a square of a Hamiltonian cycle appears in the random graph G n,p . In this paper we give a common generalization of the original notion of q spread hypergraphs and the variant used by Kahn et al.


Section 108 and Software Collections, A User's Guide. This user's guide explains Section 108 of the U.S. Copyright Act, a set of rights for libraries and archives, in the context of software collections. It also addresses the interaction between Section 108 and fair use (Section 107) in this context. The guide will help library and archives workers who preserve and provide access to software collections to navigate U.S. copyright law.


An Evolutionary Game Model for Understanding Fraud in Consumption Taxes. This paper presents a computational evolutionary game model to study and understand fraud dynamics in the consumption tax system. Players are cooperators if they correctly declare their value added tax (VAT), and are defectors otherwise. Each player's payoff is influenced by the amount evaded and the subjective probability of being inspected by tax authorities. Since transactions between companies must be declared by both the buyer and seller, a strategy adopted by one influences the other's payoff. We study the model with a well mixed population and different scale free networks. Model parameters were calibrated using real world data of VAT declarations by businesses registered in the Canary Islands region of Spain. We analyzed several scenarios of audit probabilities for high and low transactions and their prevalence in the population, as well as social rewards and penalties to find the most efficient policy to increase the proportion of cooperators. Two major insights were found. First, increasing the subjective audit probability for low transactions is more efficient than increasing this probability for high transactions. Second, favoring social rewards for cooperators or alternative penalties for defectors can be effective policies, but their success depends on the distribution of the audit probability for low and high transactions.


Bi fidelity stochastic collocation methods for epidemic transport models with uncertainties. Uncertainty in data is certainly one of the main problems in epidemiology, as shown by the recent COVID 19 pandemic. The need for efficient methods capable of quantifying uncertainty in the mathematical model is essential in order to produce realistic scenarios of the spread of infection. In this paper, we introduce a bi fidelity approach to quantify uncertainty in spatially dependent epidemic models. The approach is based on evaluating a high fidelity model on a small number of samples properly selected from a large number of evaluations of a low fidelity model. In particular, we will consider the class of multiscale transport models recently introduced in Bertaglia, Boscheri, Dimarco Pareschi, Math. Biosci. Eng. (2021) and Boscheri, Dimarco Pareschi, Math. Mod. Meth. App. Scie. (2021) as the high fidelity reference and use simple two velocity discrete models for low fidelity evaluations. Both models share the same diffusive behavior and are solved with ad hoc asymptotic preserving numerical discretizations. A series of numerical experiments confirm the validity of the approach.


Closing the B tree vs. LSM tree Write Amplification Gap on Modern Storage Hardware with Built in Transparent Compression. This paper studies the design of B tree that can take full advantage of modern storage hardware with built in transparent compression. Recent years have witnessed significant interest in applying log structured merge tree (LSM tree) as an alternative to B tree. The current consensus is that, compared with B tree, LSM tree has distinct advantages in terms of storage space efficiency and write amplification. This paper argues that one should revisit this belief upon the arrival of storage hardware with built in transparent compression. Advanced storage appliances (e.g., all flash array) and emerging computational storage drives perform hardware based lossless data compression, transparent to OS and user applications. Beyond straightforwardly reducing the physical storage cost difference between B tree and LSM tree, such modern storage hardware brings new opportunities to innovate B tree implementation in order to largely reduce its write amplification. As the first step to explore the potential, this paper presents three simple design techniques (i.e., deterministic page shadowing, localized page modification logging, and sparse redo logging) that can leverage such modern storage hardware to significantly reduce the B tree write amplification. We implemented these design techniques and carried out experiments on a commercial storage drive with built in transparent compression. The results show that the proposed design techniques can reduce the B tree write amplification by over 10x. Compared with RocksDB (a popular key value store built upon LSM tree), the implemented B tree can achieve similar or even smaller write amplification and physical storage space usage.


Domain Specific Suppression for Adaptive Object Detection. Domain adaptation methods face performance degradation in object detection, as the complexity of tasks require more about the transferability of the model. We propose a new perspective on how CNN models gain the transferability, viewing the weights of a model as a series of motion patterns. The directions of weights, and the gradients, can be divided into domain specific and domain invariant parts, and the goal of domain adaptation is to concentrate on the domain invariant direction while eliminating the disturbance from domain specific one. Current UDA object detection methods view the two directions as a whole while optimizing, which will cause domain invariant direction mismatch even if the output features are perfectly aligned. In this paper, we propose the domain specific suppression, an exemplary and generalizable constraint to the original convolution gradients in backpropagation to detach the two parts of directions and suppress the domain specific one. We further validate our theoretical analysis and methods on several domain adaptive object detection tasks, including weather, camera configuration, and synthetic to real world adaptation. Our experiment results show significant advance over the state of the art methods in the UDA object detection field, performing a promotion of 10.2 sim12.2 mAP on all these domain adaptation scenarios.


fybrrStream A WebRTC based Efficient and Scalable P2P Live Streaming Platform. The demand for streaming media and live video conferencing is at peak and expected to grow further, thereby the need for low cost streaming services with better quality and lower latency is essential. Therefore, in this paper, we propose a novel peer to peer (P2P) live streaming platform, called fybrrStream, where a logical mesh and physical tree i.e., hybrid topology based approach is leveraged for low latency streaming. fybrrStream distributes the load on participating peers in a hierarchical manner by considering their network bandwidth, network latency, and node stability. fybrrStream costs as low as the cost of just hosting a light weight website and the performance is comparable to the existing state of the art media streaming services. We evaluated and tested the proposed fybrrStream platform with real field experiments using 50 users spread across India and results obtained show significant improvements in the live streaming performance over other schemes.


Kodaira dimension of fibrations over abelian varieties. We prove an additivity result for the log Kodaira dimension of algebraic fiber spaces over abelian varieties, a superadditivity result for fiber spaces over varieties of maximal Albanese dimension, as well as a subadditivity result for log pairs.


Distributed Compilation System for High Speed Software Build Processes. The idle time of personal computers has increased steadily due to the generalization of computer usage and cloud computing. Clustering research aims at utilizing idle computer resources for processing a variable workload on a large number of computers. The workload is processed continually despite the volatile status of the individual computer resources. This paper proposes a distributed compilation system for improving the processing speed of CPU intensive software compilations. This significantly reduces the compilation time of mass sources by using the idle resources. We expect gains of up to 65 compared to non distributed compilation systems.


The reaction to news in live betting. Sports betting markets have grown very rapidly recently, with the total European gambling market worth 98.6 billion euro in 2019. Considering a high resolution (1 Hz) data set provided by a large European bookmaker, we investigate the effect of news on the dynamics of live betting. In particular, we consider stakes placed in a live betting market during football matches. Accounting for the general market activity level within a state space modelling framework, we focus on the market's response to events such as goals (i.e. major news), but also to the general situation within a match such as the uncertainty about the outcome. Our results indicate that markets might overreact to recent news, confirming cognitive biases known from psychology and behavioural economics.


New Results on Permutation Binomials of Finite Fields. After a brief review of existing results on permutation binomials of finite fields, we introduce the notion of equivalence among permutation binomials (PBs) and describe how to bring a PB to its canonical form under equivalence. We then focus on PBs of Bbb F q 2 of the form X n(X d(q 1) a) , where n and d are positive integers and a in Bbb F q 2 . Our contributions include two nonexistence results (1) If q is even and sufficiently large and a q 1 ne 1 , then X n(X 3(q 1) a) is not a PB of Bbb F q 2 . (2) If 2 le d mid q 1 , q is sufficiently large and a q 1 ne 1 , then X n(X d(q 1) a) is not a PB of Bbb F q 2 under certain additional conditions. (1) partially confirms a recent conjecture by Tu et al. (2) is an extension of a previous result with n 1 .


Stochastic viscosity solutions of reflected stochastic partial differential equations with non Lipschitz coefficients. This paper, is an attempt to extend the notion of stochastic viscosity solution to reflected semi linear stochastic partial differential equations (RSPDEs, in short) with non Lipschitz condition on the coefficients. Our method is fully probabilistic and use the recently developed theory on reflected backward doubly stochastic differential equations (RBDSDEs, in short). Among other, we prove the existence of the stochastic viscosity solution, and further extend the nonlinear Feynman Kac formula to reflected SPDEs, like one appear in cite 2 . Indeed, in their recent work, Aman and Mrhardy cite 2 established a stochastic viscosity solution for semi linear reflected SPDEs with nonlinear Neumann boundary condition by using its connection with RBDSDEs. However, even Aman and Mrhardy consider a general class of reflected SPDEs, all their coefficients are at least Lipschitz. Therefore, our current work can be thought of as a new generalization of a now well know Feymann Kac formula to SPDEs with large class of coefficients, which does not seem to exist in the literature. In other words, our work extends (in non boundary case) Aman and Mrhardy's paper.


Visual Question Answering based on Formal Logic. Visual question answering (VQA) has been gaining a lot of traction in the machine learning community in the recent years due to the challenges posed in understanding information coming from multiple modalities (i.e., images, language). In VQA, a series of questions are posed based on a set of images and the task at hand is to arrive at the answer. To achieve this, we take a symbolic reasoning based approach using the framework of formal logic. The image and the questions are converted into symbolic representations on which explicit reasoning is performed. We propose a formal logic framework where (i) images are converted to logical background facts with the help of scene graphs, (ii) the questions are translated to first order predicate logic clauses using a transformer based deep learning model, and (iii) perform satisfiability checks, by using the background knowledge and the grounding of predicate clauses, to obtain the answer. Our proposed method is highly interpretable and each step in the pipeline can be easily analyzed by a human. We validate our approach on the CLEVR and the GQA dataset. We achieve near perfect accuracy of 99.6 on the CLEVR dataset comparable to the state of art models, showcasing that formal logic is a viable tool to tackle visual question answering. Our model is also data efficient, achieving 99.1 accuracy on CLEVR dataset when trained on just 10 of the training data.


Construction and Commissioning of Mid Infrared SASE FEL at cERL. The mid infrared range is an important spectrum range where materials exhibit a characteristic response corresponding to their molecular structure. A free electron laser (FEL) is a promising candidate for a high power light source with wavelength tunability to investigate the nonlinear response of materials. Although the self amplification spontaneous emission (SASE) scheme is not usually adopted in the mid infrared wavelength range, it may have advantages such as layout simplicity, the possibility of producing a single pulse, and scalability to a short wavelength facility. To demonstrate the operation of a mid infrared SASE FEL system in an energy recovery linac (ERL) layout, we constructed an SASE FEL setup in cERL, a test facility of the superconducting linac with the ERL configuration. Despite the adverse circumstance of space charge effects due to the given boundary condition of the facility, we successfully established the beam condition at the undulators, and observed FEL emission at a wavelength of 20 mu m. The results show that the layout of cERL has the potential for serving as a mid infrared light source.


Gorenstein algebras and toric bundles. We study commutative algebras with Gorenstein duality, i.e. algebras A equipped with a non degenerate bilinear pairing such that langle ac,b rangle langle a,bc rangle for any a,b,c in A . If an algebra A is Artinian, such pairing exists if and only if A is Gorenstein. We give a description of algebras with Gorenstein duality as a quotients of the ring of differential operators by the annihilator of an explicit polynomial (or more generally formal polynomial series). This provides a calculation of Macaulay's inverse systems for (not necessarily Artinian) algebras with Gorenstein duality. Our description generalizes previously know description of graded algebras with Gorenstein duality generated in degree 1. Our main motivation comes from the study of even degree cohomology rings. In particular, we apply our main result to compute the ring of cohomology classes of even degree of toric bundles and the ring of conditions of horospherical homogeneous spaces.


Proportional Participatory Budgeting with Substitute Projects. Participatory budgeting is a democratic process for allocating funds to projects based on the votes of members of the community. However, most input methods of voters' preferences prevent the voters from expressing complex relationships among projects, leading to outcomes that do not reflect their preferences well enough. In this paper, we propose an input method that begins to address this challenge, by allowing participants to express substitutes over projects. Then, we extend a known aggregation mechanism from the literature (Rule X) to handle substitute projects. We prove that our extended rule preserves proportionality under natural conditions, and show empirically that it obtains substantially more welfare than the original mechanism on instances with substitutes.


Scoring from Pairwise Winning Indices. The pairwise winning indices, computed in the Stochastic Multicriteria Acceptability Analysis, give the probability with which an alternative is preferred to another taking into account all the instances of the assumed preference model compatible with the information provided by the Decision Maker in terms of pairwise preference comparisons of reference alternatives. In this paper we present a new scoring method assigning a value to each alternative summarizing the results of the pairwise winning indices. Several procedures assigning a score to each alternative on the basis of the pairwise winning indices have been provided in literature. However, while all of them compute this score just to rank the alternatives under consideration, our method, expressing the score in terms of an additive value function, permits to disaggregate the overall evaluation of each alternative in the sum of contributions of considered criteria. This will permit not only to rank the alternatives but also to explain the reasons for which an alternative obtains its evaluation and, consequently, fills a certain ranking position. To prove the efficiency of the method in representing the preferences of the Decision Maker, we performed an extensive set of simulations varying the number of alternatives and criteria. The results of the simulations, analyzed from a statistical point of view, show the goodness of our procedure. The applicability of the method to decision making problems is explained by means of a case study related to the evaluation of financial funds.


Self Supervised Euphemism Detection and Identification for Content Moderation. Fringe groups and organizations have a long history of using euphemisms ordinary sounding words with a secret meaning to conceal what they are discussing. Nowadays, one common use of euphemisms is to evade content moderation policies enforced by social media platforms. Existing tools for enforcing policy automatically rely on keyword searches for words on a "ban list", but these are notoriously imprecise even when limited to swearwords, they can still cause embarrassing false positives. When a commonly used ordinary word acquires a euphemistic meaning, adding it to a keyword based ban list is hopeless consider "pot" (storage container or marijuana?) or "heater" (household appliance or firearm?) The current generation of social media companies instead hire staff to check posts manually, but this is expensive, inhumane, and not much more effective. It is usually apparent to a human moderator that a word is being used euphemistically, but they may not know what the secret meaning is, and therefore whether the message violates policy. Also, when a euphemism is banned, the group that used it need only invent another one, leaving moderators one step behind. This paper will demonstrate unsupervised algorithms that, by analyzing words in their sentence level context, can both detect words being used euphemistically, and identify the secret meaning of each word. Compared to the existing state of the art, which uses context free word embeddings, our algorithm for detecting euphemisms achieves 30 400 higher detection accuracies of unlabeled euphemisms in a text corpus. Our algorithm for revealing euphemistic meanings of words is the first of its kind, as far as we are aware. In the arms race between content moderators and policy evaders, our algorithms may help shift the balance in the direction of the moderators.


On the reproducibility of enzyme reactions and kinetic modelling. Enzyme reactions are highly dependent on reaction conditions. To ensure reproducibility of enzyme reaction parameters, experiments need to be carefully designed and kinetic modelling meticulously executed. Furthermore, to enable the judgement of the quality of enzyme reaction parameters, the experimental conditions, the modelling process as well as the raw data need to be reported comprehensively. By taking these steps, enzyme reaction parameters can be open and FAIR (findable, accessible, interoperable, re usable) as well as repeatable, replicable and reproducible. This review discusses these issues and provides a practical guide to designing initial rate experiments for the determination of enzyme reaction parameters and gives an open, FAIR and re editable example of the kinetic modelling of an enzyme reaction. Both the guide and example are scripted with Python in Jupyter Notebooks and are publicly available (https fairdomhub.org investigations 483). Finally, the prerequisites of automated data analysis and machine learning algorithms are briefly discussed to provide further motivation for the comprehensive, open and FAIR reporting of enzyme reaction parameters.


Dense and longdterm monitoring of Earth surface processes with passive RFID a review. Billions of Radio Frequency Identification (RFID) passive tags are produced yearly to identify goods remotely. New research and business applications are continuously arising, including recently localization and sensing to monitor earth surface processes. Indeed, passive tags can cost 10 to 100 times less than wireless sensors networks and require little maintenance, facilitating years long monitoring with ten's to thousands of tags. This study reviews the existing and potential applications of RFID in geosciences. The major and mature application today is the study of coarse sediment transport during floods or debris flows, using tags placed into pebbles. More recently, tag localization was used to monitor landslide displacement, with a centimetric accuracy. Sensing tags were used to detect a displacement threshold on unstable rocks, and to monitor the moisture or the temperature of the soil. Propagation based sensing was applied to monitor the properties of a volume of snow. RFID sensors, available today, can be applied to monitor other parameters, such as the vibration of structures, the tilt of unstable boulders, the strain of a material, or the salinity of water. We discuss the key challenges for using RFID monitoring more broadly in geosciences the use of unmanned aerial vehicles to collect data or localize tags, the increase in reading range and duration, the ability to use tags placed under ground, snow, water or vegetation, and the optimization of economical and environmental cost. As a pattern, passive RFID could fill a gap between wireless sensor networks and manual measurements, to collect data efficiently over large areas, during several years, at high spatial density and moderate cost.


Evaluation of machine learning algorithms for predictive Reynolds stress transport modeling. The application machine learning (ML) algorithms to turbulence modeling has shown promise over the last few years, but their application has been restricted to eddy viscosity based closure approaches. In this article we discuss rationale for the application of machine learning with high fidelity turbulence data to develop models at the level of Reynolds stress transport modeling. Based on these rationale we compare different machine learning algorithms to determine their efficacy and robustness at modeling the different transport processes in the Reynolds Stress Transport Equations. Those data driven algorithms include Random forests, gradient boosted trees and neural networks. The direct numerical simulation (DNS) data for flow in channels is used both as training and testing of the ML models. The optimal hyper parameters of the ML algorithms are determined using Bayesian optimization. The efficacy of above mentioned algorithms is assessed in the modeling and prediction of the terms in the Reynolds stress transport equations. It was observed that all the three algorithms predict the turbulence parameters with acceptable level of accuracy. These ML models are then applied for prediction of the pressure strain correlation of flow cases that are different from the flows used for training, to assess their robustness and generalizability. This explores the assertion that ML based data driven turbulence models can overcome the modeling limitations associated with the traditional turbulence models and ML models trained with large amounts data with different classes of flows can predict flow field with reasonable accuracy for unknown flows with similar flow physics. In addition to this verification we carry out validation for the final ML models by assessing the importance of different input features for prediction.


Breather molecular complexes in a passively mode locked fibre laser. Breathing solitons are nonlinear waves in which the energy concentrates in a localized and oscillatory fashion. Similarly to stationary solitons, breathers in dissipative systems can form stable bound states displaying molecule like dynamics, which are frequently called breather molecules. So far, the experimental observation of optical breather molecules and the real time detection of their dynamics have been limited to diatomic molecules, that is, bound states of only two breathers. In this work, we report on the observation of different types of breather complexes in a mode locked fibre laser multi breather molecules, and molecular complexes originating from the binding of two breather pair molecules or a breather pair molecule and a single breather. The inter molecular temporal separation of the molecular complexes attains several hundreds of picoseconds, which is more than an order of magnitude larger than that of their stationary soliton counterparts and is a signature of long range interactions. Numerical simulations of the laser model support our experimental findings. Moreover, non equilibrium dynamics of breathing solitons are also observed, including breather collisions and annihilation. Our work opens the possibility of studying the dynamics of many body systems in which breathers are the elementary constituents.


Prototype Memory for Large scale Face Representation Learning. Face representation learning using datasets with a massive number of identities requires appropriate training methods. Softmax based approach, currently the state of the art in face recognition, in its usual "full softmax" form is not suitable for datasets with millions of persons. Several methods, based on the "sampled softmax" approach, were proposed to remove this limitation. These methods, however, have a set of disadvantages. One of them is a problem of "prototype obsolescence" classifier weights (prototypes) of the rarely sampled classes receive too scarce gradients and become outdated and detached from the current encoder state, resulting in incorrect training signals. This problem is especially serious in ultra large scale datasets. In this paper, we propose a novel face representation learning model called Prototype Memory, which alleviates this problem and allows training on a dataset of any size. Prototype Memory consists of the limited size memory module for storing recent class prototypes and employs a set of algorithms to update it in appropriate way. New class prototypes are generated on the fly using exemplar embeddings in the current mini batch. These prototypes are enqueued to the memory and used in a role of classifier weights for softmax classification based training. To prevent obsolescence and keep the memory in close connection with the encoder, prototypes are regularly refreshed, and oldest ones are dequeued and disposed of. Prototype Memory is computationally efficient and independent of dataset size. It can be used with various loss functions, hard example mining algorithms and encoder architectures. We prove the effectiveness of the proposed model by extensive experiments on popular face recognition benchmarks.


Hyperbolic Coxeter groups of minimal growth rates in higher dimensions. The cusped hyperbolic n orbifolds of minimal volume are well known for n leq 9 . Their fundamental groups are related to the Coxeter n simplex groups Gamma n listed in Table 1. In this work, we prove that Gamma n has minimal growth rate among all non cocompact Coxeter groups of finite covolume in hbox Isom mathbb H n . In this way, we extend previous results of Floyd for n 2 and of Kellerhals for n 3 respectively. Our proof is a generalisation of the methods developed in 2 for the cocompact case.


Privacy aware Process Performance Indicators Framework and Release Mechanisms. Process performance indicators (PPIs) are metrics to quantify the degree with which organizational goals defined based on business processes are fulfilled. They exploit the event logs recorded by information systems during the execution of business processes, thereby providing a basis for process monitoring and subsequent optimization. However, PPIs are often evaluated on processes that involve individuals, which implies an inevitable risk of privacy intrusion. In this paper, we address the demand for privacy protection in the computation of PPIs. We first present a framework that enforces control over the data exploited for process monitoring. We then show how PPIs defined based on the established PPINOT meta model are instantiated in this framework through a set of data release mechanisms. These mechanisms are designed to provide provable guarantees in terms of differential privacy. We evaluate our framework and the release mechanisms in a series of controlled experiments. We further use a public event log to compare our framework with approaches based on privatization of event logs. The results demonstrate feasibility and shed light on the trade offs between data utility and privacy guarantees in the computation of PPIs.


Parameterized algorithms for identifying gene co expression modules via weighted clique decomposition. We present a new combinatorial model for identifying regulatory modules in gene co expression data using a decomposition into weighted cliques. To capture complex interaction effects, we generalize the previously studied weighted edge clique partition problem. As a first step, we restrict ourselves to the noise free setting, and show that the problem is fixed parameter tractable when parameterized by the number of modules (cliques). We present two new algorithms for finding these decompositions, using linear programming and integer partitioning to determine the clique weights. Further, we implement these algorithms in Python and test them on a biologically inspired synthetic corpus generated using real world data from transcription factors and a latent variable analysis of co expression in varying cell types.


The Multiplicative Persistence Conjecture Is True for Odd Targets. In 1973, Neil Sloane published a very short paper introducing an intriguing problem Pick a decimal integer n and multiply all its digits by each other. Repeat the process until a single digit Delta(n) is obtained. Delta(n) is called the textsl multiplicative digital root of n or textsl the target of n . The number of steps Xi(n) needed to reach Delta(n) , called the multiplicative persistence of n or textsl the height of n is conjectured to always be at most 11 . Like many other very simple to state number theoretic conjectures, the multiplicative persistence mystery resisted numerous explanation attempts. This paper proves that the conjecture holds for all odd target values Namely that if Delta(n) in 1,3,7,9 , then Xi(n) leq 1 and that if Delta(n) 5 , then Xi(n) leq 5 . Naturally, we overview the difficulties currently preventing us from extending the approach to (nonzero) even targets.


Rational Shapley Values. Explaining the predictions of opaque machine learning algorithms is an important and challenging task, especially as complex models are increasingly used to assist in high stakes decisions such as those arising in healthcare and finance. Most popular tools for post hoc explainable artificial intelligence (XAI) are either insensitive to context (e.g., feature attributions) or difficult to summarize (e.g., counterfactuals). In this paper, I introduce emph rational Shapley values , a novel XAI method that synthesizes and extends these seemingly incompatible approaches in a rigorous, flexible manner. I leverage tools from decision theory and causal modeling to formalize and implement a pragmatic approach that resolves a number of known challenges in XAI. By pairing the distribution of random variables with the appropriate reference class for a given explanation task, I illustrate through theory and experiments how user goals and knowledge can inform and constrain the solution set in an iterative fashion. The method compares favorably to state of the art XAI tools in a range of quantitative and qualitative comparisons.


Smooth Approximations and Relational Width Collapses. We prove that relational structures admitting specific polymorphisms (namely, canonical pseudo WNU operations of all arities n geq 3 ) have low relational width. This implies a collapse of the bounded width hierarchy for numerous classes of infinite domain CSPs studied in the literature. Moreover, we obtain a characterization of bounded width for first order reducts of unary structures and a characterization of MMSNP sentences that are equivalent to a Datalog program, answering a question posed by Bienvenu, ten Cate, Lutz, and Wolter. In particular, the bounded width hierarchy collapses in those cases as well.


On chip Acousto Thermal Shift Assay for Rapid and Sensitive Assessment of Protein Thermodynamic Stability. Thermal shift assays (TSAs) have been extensively used to study thermodynamics of proteins and provide an efficient means to assess protein ligand binding or protein protein interaction. However, existing TSAs have limitations such as time consuming, labor intensive, or low sensitivity. Here we introduce a novel acousto thermal shift assay (ATSA), the first ultrasound enabled TSA, for real time analysis of protein thermodynamic stability. It capitalizes the novel coupling of unique acoustic mechanisms to achieve protein unfolding, concentration, and measurement on a single microfluidic chip within minutes. Compared to conventional TSA methods, our ATSA technique enabled ultra fast (at least 30 times faster), highly sensitive (7 34 folds higher), and label free monitoring of protein ligand interactions and protein stability. ATSA paves new avenues for protein analysis in biology, medicine and fast diagnosis.


Quantization based approximation of reflected BSDEs with extended upper bounds for recursive quantization. We establish upper bounds for the L p quantization error, p in (1, 2 d), induced by the recursive Markovian quantization of a d dimensional diffusion discretized via the Euler scheme. We introduce a hybrid recursive quantization scheme, easier to implement in the high dimensional framework, and establish upper bounds to the corresponding L p quantization error. To take advantage of these extensions, we propose a time discretization scheme and a recursive quantization based discretization scheme associated to a reflected Backward Stochastic Differential Equation and estimate L p error bounds induced by the space approximation. We will explain how to numerically compute the solution of the reflected BSDE relying on the recursive quantization and compare it to other types of quantization.


Observation of optical gyromagnetic properties in a magneto plasmonic metamaterial. Metamaterials with artificial optical properties have attracted significant research interest. In particular, artificial magnetic resonances in non unity permeability tensor at optical frequencies in metamaterials have been reported. However, only non unity diagonal elements of the permeability tensor have been demonstrated to date. A gyromagnetic permeability tensor with non zero off diagonal elements has not been observed at the optical frequencies. Here we report the observation of gyromagnetic properties in the near infrared wavelength range in a magneto plasmonic metamaterial. The non zero off diagonal permeability tensor element causes the transverse magneto optical Kerr effect (TMOKE) under s polarized incidence that otherwise vanishes if the permeability tensor is not gyromagnetic. By retrieving the permeability tensor elements from reflection, transmission, and TMOKE spectra, we show that the effective off diagonal permeability tensor elements reach the 10 3 level at the resonance wavelength ( 900 nm) of the split ring resonators that is at least two orders of magnitude higher than that of magneto optical materials at the same wavelength. The artificial gyromagnetic permeability is attributed to the change in the local electric field direction modulated by the split ring resonators. Our study demonstrates the possibility of engineering the permeability and permittivity tensors in metamaterials at arbitrary frequencies, thereby promising a variety of applications of next generation nonreciprocal photonic devices, magneto plasmonic sensors, and active metamaterials.


RadGraph Extracting Clinical Entities and Relations from Radiology Reports. Extracting structured clinical information from free text radiology reports can enable the use of radiology report information for a variety of critical healthcare applications. In our work, we present RadGraph, a dataset of entities and relations in full text chest X ray radiology reports based on a novel information extraction schema we designed to structure radiology reports. We release a development dataset, which contains board certified radiologist annotations for 500 radiology reports from the MIMIC CXR dataset (14,579 entities and 10,889 relations), and a test dataset, which contains two independent sets of board certified radiologist annotations for 100 radiology reports split equally across the MIMIC CXR and CheXpert datasets. Using these datasets, we train and test a deep learning model, RadGraph Benchmark, that achieves a micro F1 of 0.82 and 0.73 on relation extraction on the MIMIC CXR and CheXpert test sets respectively. Additionally, we release an inference dataset, which contains annotations automatically generated by RadGraph Benchmark across 220,763 MIMIC CXR reports (around 6 million entities and 4 million relations) and 500 CheXpert reports (13,783 entities and 9,908 relations) with mappings to associated chest radiographs. Our freely available dataset can facilitate a wide range of research in medical natural language processing, as well as computer vision and multi modal learning when linked to chest radiographs.


PALMAR Towards Adaptive Multi inhabitant Activity Recognition in Point Cloud Technology. With the advancement of deep neural networks and computer vision based Human Activity Recognition, employment of Point Cloud Data technologies (LiDAR, mmWave) has seen a lot interests due to its privacy preserving nature. Given the high promise of accurate PCD technologies, we develop, PALMAR, a multiple inhabitant activity recognition system by employing efficient signal processing and novel machine learning techniques to track individual person towards developing an adaptive multi inhabitant tracking and HAR system. More specifically, we propose (i) a voxelized feature representation based real time PCD fine tuning method, (ii) efficient clustering (DBSCAN and BIRCH), Adaptive Order Hidden Markov Model based multi person tracking and crossover ambiguity reduction techniques and (iii) novel adaptive deep learning based domain adaptation technique to improve the accuracy of HAR in presence of data scarcity and diversity (device, location and population diversity). We experimentally evaluate our framework and systems using (i) a real time PCD collected by three devices (3D LiDAR and 79 GHz mmWave) from 6 participants, (ii) one publicly available 3D LiDAR activity data (28 participants) and (iii) an embedded hardware prototype system which provided promising HAR performances in multi inhabitants (96 ) scenario with a 63 improvement of multi person tracking than state of art framework without losing significant system performances in the edge computing device.


Property A and duality in linear programming. Property A is a form of weak amenability for groups and metric spaces introduced as an approach to the famous Novikov higher signature conjecture, one of the most important unsolved problems in topology. We show that property A can be reduced to a sequence of linear programming optimization problems on finite graphs. We explore the dual problems, which turn out to have interesting interpretations as combinatorial problems concerning the maximum total supply of flows on a network. Using isoperimetric inequalities, we relate the dual problems to the Cheeger constant of the graph and explore the role played by symmetry of a graph to obtain a striking characterization of the difference between an expander and a graph without property A. Property A turns out to be a new measure of connectivity of a graph that is relevant to graph theory. The dual linear problems can be solved using a variety of methods, which we demonstrate on several enlightening examples. As a demonstration of the power of this linear programming approach we give elegant proofs of theorems of Nowak and Willett about graphs without property A.


An immersed interface method for the 2D vorticity velocity Navier Stokes equations with multiple bodies. We present an immersed interface method for the vorticity velocity form of the 2D Navier Stokes equations that directly addresses challenges posed by multiply connected domains, nonconvex obstacles, and the calculation of force distributions on immersed surfaces. The immersed interface method is re interpreted as a polynomial extrapolation of flow quantities and boundary conditions into the obstacle, reducing its computational and implementation complexity. In the flow, the vorticity transport equation is discretized using a conservative finite difference scheme and explicit Runge Kutta time integration. The velocity reconstruction problem is transformed to a scalar Poisson equation that is discretized with conservative finite differences, and solved using an FFT accelerated iterative algorithm. The use of conservative differencing throughout leads to exact enforcement of a discrete Kelvin's theorem, which provides the key to simulations with multiply connected domains and outflow boundaries. The method achieves second order spatial accuracy and third order temporal accuracy, and is validated on a variety of 2D flows in internal and free space domains.


Evaluating Gender Bias in Hindi English Machine Translation. With language models being deployed increasingly in the real world, it is essential to address the issue of the fairness of their outputs. The word embedding representations of these language models often implicitly draw unwanted associations that form a social bias within the model. The nature of gendered languages like Hindi, poses an additional problem to the quantification and mitigation of bias, owing to the change in the form of the words in the sentence, based on the gender of the subject. Additionally, there is sparse work done in the realm of measuring and debiasing systems for Indic languages. In our work, we attempt to evaluate and quantify the gender bias within a Hindi English machine translation system. We implement a modified version of the existing TGBI metric based on the grammatical considerations for Hindi. We also compare and contrast the resulting bias measurements across multiple metrics for pre trained embeddings and the ones learned by our machine translation model.


A quantum complexity approach to the Kirchberg Embedding Problem. The Kirchberg Embedding Problem (KEP) asks if every C algebra embeds into an ultrapower of the Cuntz algebra cal O 2 . Motivated by the recent refutation of the Connes Embedding Problem using the quantum complexity result MIP RE, we establish two quantum complexity consequences of a positive solution to KEP. Both results involve almost commuting strategies to nonlocal games.


Towards Zero and Few shot Knowledge seeking Turn Detection in Task orientated Dialogue Systems. Most prior work on task oriented dialogue systems is restricted to supporting domain APIs. However, users may have requests that are out of the scope of these APIs. This work focuses on identifying such user requests. Existing methods for this task mainly rely on fine tuning pre trained models on large annotated data. We propose a novel method, REDE, based on adaptive representation learning and density estimation. REDE can be applied to zero shot cases, and quickly learns a high performing detector with only a few shots by updating less than 3K parameters. We demonstrate REDE's competitive performance on DSTC9 data and our newly collected test set.


A3C S Automated Agent Accelerator Co Search towards Efficient Deep Reinforcement Learning. Driven by the explosive interest in applying deep reinforcement learning (DRL) agents to numerous real time control and decision making applications, there has been a growing demand to deploy DRL agents to empower daily life intelligent devices, while the prohibitive complexity of DRL stands at odds with limited on device resources. In this work, we propose an Automated Agent Accelerator Co Search (A3C S) framework, which to our best knowledge is the first to automatically co search the optimally matched DRL agents and accelerators that maximize both test scores and hardware efficiency. Extensive experiments consistently validate the superiority of our A3C S over state of the art techniques.


State estimation with limited sensors A deep learning based approach. The importance of state estimation in fluid mechanics is well established it is required for accomplishing several tasks including design optimization, active control, and future state prediction. A common tactic in this regards is to rely on reduced order models. Such approaches, in general, use measurement data of one time instance. However, oftentimes data available from sensors is sequential and ignoring it results in information loss. In this paper, we propose a novel deep learning based state estimation framework that learns from sequential data. The proposed model structure consists of the recurrent cell to pass information from different time steps enabling utilization of this information to recover the full state. We illustrate that utilizing sequential data allows for state recovery from only one or two sensors. For efficient recovery of the state, the proposed approached is coupled with an auto encoder based reduced order model. We illustrate the performance of the proposed approach using two examples and it is found to outperform other alternatives existing in the literature.


Layer wise Model Pruning based on Mutual Information. The proposed pruning strategy offers merits over weight based pruning techniques (1) it avoids irregular memory access since representations and matrices can be squeezed into their smaller but dense counterparts, leading to greater speedup (2) in a manner of top down pruning, the proposed method operates from a more global perspective based on training signals in the top layer, and prunes each layer by propagating the effect of global signals through layers, leading to better performances at the same sparsity level. Extensive experiments show that at the same sparsity level, the proposed strategy offers both greater speedup and higher performances than weight based pruning methods (e.g., magnitude pruning, movement pruning).


The integral Mittag Leffler, Whittaker and Wright functions. Integral Mittag Leffler, Whittaker and Wright functions with integrands similar to those which already exist in mathematical literature are introduced for the first time. For particular values of parameters, they can be presented in closed form. In most reported cases, these new integral functions are expressed as generalized hypergeometric functions but also in terms of elementary and special functions. The behavior of some of the new integral functions is presented in graphical form. By using the MATHEMATICA program to obtain infinite sums that define the Mittag Leffler, Whittaker, and Wright functions and also their corresponding integral functions, these functions and many new Laplace transforms of them are also reported in the Appendices for integral and fractional values of parameters.


Parallel Algorithms for Masked Sparse Matrix Matrix Products. Computing the product of two sparse matrices (SpGEMM) is a fundamental operation in various combinatorial and graph algorithms as well as various bioinformatics and data analytics applications for computing inner product similarities. For an important class of algorithms, only a subset of the output entries are needed, and the resulting operation is known as Masked SpGEMM since a subset of the output entries is considered to be "masked out". Existing algorithms for Masked SpGEMM usually do not consider mask as part of multiplication and either first compute a regular SpGEMM followed by masking, or perform a sparse inner product only for output elements that are not masked out. In this work, we investigate various novel algorithms and data structures for this rather challenging and important computation, and provide guidelines on how to design a fast Masked SpGEMM for shared memory architectures. Our evaluations show that factors such as matrix and mask density, mask structure and cache behavior play a vital role in attaining high performance for Masked SpGEMM. We evaluate our algorithms on a large number of matrices using several real world benchmarks and show that our algorithms in most cases significantly outperform the state of the art for Masked SpGEMM implementations.


UAVs Path Deviation Attacks Survey and Research Challenges. Recently, Unmanned Aerial Vehicles (UAVs) are employed for a plethora of civilian applications. Such flying vehicles can accomplish tasks under the pilot's eyesight within the range of a remote controller, or autonomously according to a certain pre loaded path configuration. Different path deviation attacks can be performed by malicious users against UAVs. We classify such attacks and the relative defenses based on the UAV's flight mode, i.e., (i) First Person View (FPV), (ii) civilian Global Navigation Satellite System based (GNSS), and (iii) GNSS "plus" auxiliary technologies (GNSS ), and on the multiplicity, i.e., (i) Single UAV, and (ii) Multiple UAVs. We found that very little has been done to secure the FPV flight mode against path deviation. In GNSS mode, spoofing is the most worrisome attack. The best defense against spoofing seems to be redundancy, such as adding vision chips to single UAV or using multiple arranged UAVs. No specific attacks and defenses have been found in literature for GNSS or for UAVs moving in group without a pre ordered arrangement. These aspects require further investigation.


Large deviations of lp blocks of regularly varying time series and applications to cluster inference. In the regularly varying time series setting, a cluster of exceedances is a short period for which the supremum norm exceeds a high threshold. We propose to study a generalization of this notion considering short periods, or blocks, with lp norm above a high threshold. Our main result derives new large deviation principles of extremal lp blocks. We show an application to cluster inference to motivate our result, where we design consistent disjoint blocks estimators. We focus on inferring important indices in extreme value theory, e.g., the extremal index. Our approach motivates cluster inference based on extremal lp blocks with p infty rather than the classical one with p infty where the bias is more difficult to control, as illustrated in simulations from an example. Our estimators also promote the use of large empirical quantiles from the lp norm of blocks as threshold levels which eases implementation and facilitates comparison.


From subcritical behavior to elusive transitions in rumor models. Rumor and information spreading are natural processes that emerge from human to human interaction. Mathematically, this was explored in the popular Maki Thompson model, where a phase transition was thought to be absent. Here, we show that a second order phase transition is present in this model which is not captured by first order mean field approximations. Moreover, we propose and explore a modified version of the Maki Thompson model that includes a forgetting mechanism. This modification changes the Markov chain's nature from infinitely many absorbing states in the classical setup to a single absorbing state. In practice, this allows us to use a plethora of analytic and numeric methods that permit the models' characterization. In particular, we find a counter intuitive behavior in the subcritical regime of these models, where the lifespan of a rumor increases as the spreading rate drops, following a power law relationship. This means that, even below the critical threshold, rumors can survive for a long time. Together, our findings suggest that the dynamic behavior of rumor models can be much richer than previously thought. Thus, we hope that our results motivate further research both analytically and numerically.


BIM, Digital Twin and Cyber Physical Systems crossing and blurring boundaries. Digital Twin in construction and the built environment have started to attract the attention of researchers and practitioners in recent times. Its anticipated value proposition is focussed on its capability of generating new understanding and insights into an asset at all stages of its life cycle, exploiting diverse data sets from a multitude of sources and professions, in real or near real time. However, there is still a significant debate about the delineation (i.e. communalities and differences) between digital twin and other related concepts, particularly Building Information Modelling (BIM) and Cyber Physical Systems (CPS). To date, this debate has been confined to social media discussions, insights blogs and position papers. This paper addresses this challenge using a systematic review. The aim is to investigate communalities and differences between the three concepts, Digital Twin, BIM and CPS. The results of this paper are expected to foster the discussion around this theme within construction and the built environment.


PowerLinear Activation Functions with application to the first layer of CNNs. Convolutional neural networks (CNNs) have become the state of the art tool for dealing with unsolved problems in computer vision and image processing. Since the convolution operator is a linear operator, several generalizations have been proposed to improve the performance of CNNs. One way to increase the capability of the convolution operator is by applying activation functions on the inner product operator. In this paper, we will introduce PowerLinear activation functions, which are based on the polynomial kernel generalization of the convolution operator. EvenPowLin functions are the main branch of the PowerLinear activation functions. This class of activation functions is saturated neither in the positive input region nor in the negative one. Also, the negative inputs are activated with the same magnitude as the positive inputs. These features made the EvenPowLin activation functions able to be utilized in the first layer of CNN architectures and learn complex features of input images. Additionally, EvenPowLin activation functions are used in CNN models to classify the inversion of grayscale images as accurately as the original grayscale images, which is significantly better than commonly used activation functions.


Constants of Motion The Antidote to Chaos in Optimization and Game Dynamics. Several recent works in online optimization and game dynamics have established strong negative complexity results including the formal emergence of instability and chaos even in small such settings, e.g., 2 times 2 games. These results motivate the following question Which methodological tools can guarantee the regularity of such dynamics and how can we apply them in standard settings of interest such as discrete time first order optimization dynamics? We show how proving the existence of invariant functions, i.e., constant of motions, is a fundamental contribution in this direction and establish a plethora of such positive results (e.g. gradient descent, multiplicative weights update, alternating gradient descent and manifold gradient descent) both in optimization as well as in game settings. At a technical level, for some conservation laws we provide an explicit and concise closed form, whereas for other ones we present non constructive proofs using tools from dynamical systems.


msolve A Library for Solving Polynomial Systems. We present a new open source C library texttt msolve dedicated to solving multivariate polynomial systems of dimension zero through computer algebra methods. The core algorithmic framework of texttt msolve relies on Gr ''obner bases and linear algebra based algorithms for polynomial system solving. It relies on Gr ''obner basis computation w.r.t. the degree reverse lexicographical order, Gr ''obner conversion to a lexicographical Gr ''obner basis and real solving of univariate polynomials. We explain in detail how these three main steps of the solving process are implemented, how we exploit texttt AVX2 instruction processors and the more general implementation ideas we put into practice to better exploit the computational capabilities of this algorithmic framework. We compare the practical performances of texttt msolve with leading computer algebra systems such as textsc Magma , textsc Maple , textsc Singular on a wide range of systems with finitely many complex solutions, showing that texttt msolve can tackle systems which were out of reach by the computer algebra software state of the art.


Power Saving Evaluation with Automatic Offloading. Heterogeneous hardware other than small core CPU such as GPU, FPGA, or many core CPU is increasingly being used. However, heterogeneous hardware usage presents high technical skill barriers such as familiarity with CUDA. To overcome this challenge, I previously proposed environment adaptive software that enables automatic conversion, automatic configuration, and high performance and low power operation of once written code, in accordance with the hardware to be placed. I also previously verified performance improvement of automatic GPU and FPGA offloading. In this paper, I verify low power operation with environment adaptation by evaluating power utilization after automatic offloading. I compare Watt seconds of existing applications after automatic offloading with the case of CPU only processing.


Prediction of Household level Heat Consumption using PSO enhanced SVR Model. In combating climate change, an effective demand based energy supply operation of the district energy system (DES) for heating or cooling is indispensable. As a consequence, an accurate forecast of heat consumption on the consumer side poses an important first step towards an optimal energy supply. However, due to the non linearity and non stationarity of heat consumption data, the prediction of the thermal energy demand of DES remains challenging. In this work, we propose a forecasting framework for thermal energy consumption within a district heating system (DHS) based on kernel Support Vector Regression (kSVR) using real world smart meter data. Particle Swarm Optimization (PSO) is employed to find the optimal hyper parameter for the kSVR model which leads to the superiority of the proposed methods when compared to a state of the art ARIMA model. The average MAPE is reduced to 2.07 and 2.64 for the individual meter specific forecasting and for forecasting of societal consumption, respectively.


An Investigation And Insight Into Terrorism In Nigeria. Terrorism is one of the most life challenging threats facing humanity worldwide. The activities of terrorist organizations threaten peace, disrupts progress, and halt the development of any nation. Terrorist activities in Nigeria in the last decades have negatively affected economic growth and have drastically reduced the possibilities of foreign investments in Nigeria. In this paper, statistical and inferential insights are applied to the terrorist activities in Nigeria from 1970 to 2019. Using the Global Terrorism Database (GTD), insights are made on the occurrences of terrorist attacks, the localities of the target, and the successful and unsuccessful rates of such attacks. The Apriori algorithm is also used in this paper to draw hidden patterns from the GTD to aid in generating strong rules through database mining, resulting in relevant insights. This understanding of terrorist activities will provide security agencies with the needed information to be one step ahead of terrorists in making the right decisions targeted at curbing terrorism in Nigeria.


Robust Ensembling Network for Unsupervised Domain Adaptation. Recently, in order to address the unsupervised domain adaptation (UDA) problem, extensive studies have been proposed to achieve transferrable models. Among them, the most prevalent method is adversarial domain adaptation, which can shorten the distance between the source domain and the target domain. Although adversarial learning is very effective, it still leads to the instability of the network and the drawbacks of confusing category information. In this paper, we propose a Robust Ensembling Network (REN) for UDA, which applies a robust time ensembling teacher network to learn global information for domain transfer. Specifically, REN mainly includes a teacher network and a student network, which performs standard domain adaptation training and updates weights of the teacher network. In addition, we also propose a dual network conditional adversarial loss to improve the ability of the discriminator. Finally, for the purpose of improving the basic ability of the student network, we utilize the consistency constraint to balance the error between the student network and the teacher network. Extensive experimental results on several UDA datasets have demonstrated the effectiveness of our model by comparing with other state of the art UDA algorithms.


Learning on Hardware A Tutorial on Neural Network Accelerators and Co Processors. Deep neural networks (DNNs) have the advantage that they can take into account a large number of parameters, which enables them to solve complex tasks. In computer vision and speech recognition, they have a better accuracy than common algorithms, and in some tasks, they boast an even higher accuracy than human experts. With the progress of DNNs in recent years, many other fields of application such as diagnosis of diseases and autonomous driving are taking advantage of them. The trend at DNNs is clear The network size is growing exponentially, which leads to an exponential increase in computational effort and required memory size. For this reason, optimized hardware accelerators are used to increase the performance of the inference of neuronal networks. However, there are various neural network hardware accelerator platforms, such as graphics processing units (GPUs), application specific integrated circuits (ASICs) and field programmable gate arrays (FPGAs). Each of these platforms offer certain advantages and disadvantages. Also, there are various methods for reducing the computational effort of DNNs, which are differently suitable for each hardware accelerator. In this article an overview of existing neural network hardware accelerators and acceleration methods is given. Their strengths and weaknesses are shown and a recommendation of suitable applications is given. In particular, we focus on acceleration of the inference of convolutional neural networks (CNNs) used for image recognition tasks. Given that there exist many different hardware architectures. FPGA based implementations are well suited to show the effect of DNN optimization methods on accuracy and throughput. For this reason, the focus of this work is more on FPGA based implementations.


This photograph has been altered Testing the effectiveness of image forensic labeling on news image credibility. Despite the ubiquity and proliferation of images and videos in online news environments, much of the existing research on misinformation and its correction is solely focused on textual misinformation, and little is known about how ordinary users evaluate fake or manipulated images and the most effective ways to label and correct such falsities. We designed a visual forensic label of image authenticity, Picture O Meter, and tested the label's efficacy in relation to its source and placement in an experiment with 2440 participants. Our findings demonstrate that, despite human beings' general inability to detect manipulated images on their own, image forensic labels are an effective tool for counteracting visual misinformation.


A Transferable Approach for Partitioning Machine Learning Models on Multi Chip Modules. Multi Chip Modules (MCMs) reduce the design and fabrication cost of machine learning (ML) accelerators while delivering performance and energy efficiency on par with a monolithic large chip. However, ML compilers targeting MCMs need to solve complex optimization problems optimally and efficiently to achieve this high performance. One such problem is the multi chip partitioning problem where compilers determine the optimal partitioning and placement of operations in tensor computation graphs on chiplets in MCMs. Partitioning ML graphs for MCMs is particularly hard as the search space grows exponentially with the number of chiplets available and the number of nodes in the neural network. Furthermore, the constraints imposed by the underlying hardware produce a search space where valid solutions are extremely sparse. In this paper, we present a strategy using a deep reinforcement learning (RL) framework to emit a possibly invalid candidate partition that is then corrected by a constraint solver. Using the constraint solver ensures that RL encounters valid solutions in the sparse space frequently enough to converge with fewer samples as compared to non learned strategies. The architectural choices we make for the policy network allow us to generalize across different ML graphs. Our evaluation of a production scale model, BERT, on real hardware reveals that the partitioning generated using RL policy achieves 6.11 and 5.85 higher throughput than random search and simulated annealing. In addition, fine tuning the pre trained RL policy reduces the search time from 3 hours to only 9 minutes, while achieving the same throughput as training RL policy from scratch.


Joint Inter path and Intra path Multiplexing for Terahertz Widely spaced Multi subarray Hybrid Beamforming Systems. Terahertz (THz) communications with multi GHz bandwidth are envisioned as a key technology for 6G systems. Ultra massive (UM) MIMO with hybrid beamforming architectures are widely investigated to provide a high array gain to overcome the huge propagation loss. However, most of the existing hybrid beamforming architectures can only utilize the multiplexing offered by the multipath components, i.e., inter path multiplexing, which is very limited due to the spatially sparse THz channel. In this paper, a widely spaced multi subarray (WSMS) hybrid beamforming architecture is proposed, which improves the multiplexing gain by exploiting a new type of intra path multiplexing provided by the spherical wave propagation among k widely spaced subarrays, in addition to the inter path multiplexing. The resulting multiplexing gain of WSMS architecture is k times of the existing architectures. To harness WSMS hybrid beamforming, a novel design problem is formulated by optimizing the number of subarrays, subarray spacing, and hybrid beamforming matrices to maximize the spectral efficiency, which is decomposed into two subproblems. An optimal closed form solution is derived for the first hybrid beamforming subproblem, while a dominant line of sight relaxation algorithm is proposed for the second array configuration subproblem. Extensive simulation results demonstrate that the WSMS architecture and proposed algorithms substantially enhance the spectral efficiency and energy efficiency.